-- Logs begin at Tue 2022-06-21 14:56:26 UTC, end at Tue 2022-06-21 16:17:56 UTC. -- Jun 21 15:44:53.692343 dv-cinder-840678-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 15:44:53.701582 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 15:44:53 2022] *** Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: nodename: dv-cinder-840678-13-iscsi Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: machine: x86_64 Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: clock source: unix Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: pcre jit disabled Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: detected number of CPU cores: 4 Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: current working directory: / Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: detected binary path: /usr/bin/uwsgi-core Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: your processes number limit is 47680 Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: your memory page size is 4096 bytes Jun 21 15:44:53.703735 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: detected max file descriptor number: 2048 Jun 21 15:44:53.705041 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: lock engine: pthread robust mutexes Jun 21 15:44:53.705041 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: thunder lock: enabled Jun 21 15:44:53.705041 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 15:44:53.705041 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 15:44:53.747483 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: Python main interpreter initialized at 0x563960bf89c0 Jun 21 15:44:53.747483 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: python threads support enabled Jun 21 15:44:53.747483 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: your server socket listen backlog is limited to 100 connections Jun 21 15:44:53.747483 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: your mercy for graceful operations on workers is 90 seconds Jun 21 15:44:53.747846 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 15:44:53.747939 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: *** Operational MODE: preforking *** Jun 21 15:44:53.748158 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: *** uWSGI is running in multiple interpreter mode *** Jun 21 15:44:53.748158 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: spawned uWSGI master process (pid: 109599) Jun 21 15:44:53.748334 dv-cinder-840678-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 15:44:53.749744 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: spawned uWSGI worker 1 (pid: 109600, cores: 1) Jun 21 15:44:53.749744 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: spawned uWSGI worker 2 (pid: 109601, cores: 1) Jun 21 15:44:53.749744 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 15:44:54.420619 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 15:44:54.422573 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 15:44:55.545729 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:44:55.545729 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: from cryptography.utils import int_from_bytes Jun 21 15:44:55.546365 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:44:55.546365 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: from cryptography.utils import int_from_bytes Jun 21 15:44:55.599109 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:44:55.599109 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: from cryptography.utils import int_from_bytes Jun 21 15:44:55.599699 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:44:55.599699 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: from cryptography.utils import int_from_bytes Jun 21 15:44:58.049725 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 15:44:58.050973 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 15:44:58.050973 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 15:44:58.051142 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 15:44:58.051396 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 15:44:58.051792 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.052132 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.052459 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.052788 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.053115 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.053413 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 15:44:58.053812 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.053903 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 15:44:58.053970 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.054040 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.054247 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 15:44:58.054348 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.054608 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 15:44:58.054706 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.054866 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 15:44:58.054961 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.055239 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-13-iscsi {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.055348 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.055559 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.055646 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.055863 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.055960 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.056183 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.056360 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.056559 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.056704 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.056798 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.056941 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.057129 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.057267 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.057433 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.057610 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.057960 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.058391 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.058391 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.058609 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.058716 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.058816 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.058922 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-13-iscsi {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.059039 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.059153 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.059397 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.059523 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.059653 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.059744 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.059938 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.060040 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.060266 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.060357 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.060574 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.060700 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.060902 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.061070 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.061211 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.061425 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.061626 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-13-iscsi {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.061765 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.061982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.062085 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.062306 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.062407 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.062623 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.062713 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.063010 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.063104 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.063321 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.063422 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.063647 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.063739 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.063952 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.064069 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.064278 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.064411 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.064580 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.064684 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.064906 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.065000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-13-iscsi {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.065359 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.065974 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.065974 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.066259 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.066371 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.066456 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.066536 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.066668 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.066832 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.066957 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.067145 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.067302 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.067468 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.067626 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.067782 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.067952 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.068088 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.068277 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.068416 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.068544 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.068736 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.068868 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.069059 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.069210 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.069390 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.069550 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.069695 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.069920 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.070091 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.070175 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.070383 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.070473 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.070706 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.070808 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.071013 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.071150 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.071322 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.071407 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.071575 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.071663 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.071884 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.071974 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.072206 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.072291 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.072529 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.072613 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.072854 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.072952 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.073107 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.073198 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.073360 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.073483 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.073680 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.073835 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.074025 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.074164 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.074336 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.074494 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.074633 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.074814 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.074942 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.075144 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.075252 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.075556 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.075648 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.075814 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.075915 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.076129 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.076214 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.076450 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.076540 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.076771 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.076855 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.077089 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.077174 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.077409 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.077502 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.077719 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.077843 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.078062 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.078152 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.078379 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.078473 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.078689 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.078779 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.078996 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.079079 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.079336 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.079427 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.079646 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.079735 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.079904 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.079987 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.080213 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.080306 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.080527 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.080611 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.081010 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.081188 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.081188 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.081335 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.081505 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.081590 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.081795 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.081894 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.082109 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.082193 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.082424 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.082523 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.082673 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.082836 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.082975 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.083060 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.083345 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.083438 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.083658 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.083803 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.083968 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.084053 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.084278 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.084362 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.084587 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.084723 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.084890 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.084982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.085198 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.085280 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.085512 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.085611 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.085850 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.085948 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.086161 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.086244 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.086469 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.086560 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.086774 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.086872 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.087082 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.087175 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.087386 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.087480 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.087688 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.087777 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.088005 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.088089 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.088315 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.088407 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.088620 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.088707 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.088926 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.089018 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.089231 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.089324 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.089538 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.089629 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.089883 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.089970 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.090192 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.090288 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.090496 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.090582 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.090818 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.090912 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.091120 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.091203 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.091423 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.091518 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.091728 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.091820 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.092039 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.092135 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.092343 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.092439 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.092659 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.092750 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.092967 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.093060 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.093274 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.093366 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.093578 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.093669 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.093928 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.094015 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.094257 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.094341 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.094557 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.094653 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.094860 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.094953 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.095162 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.095249 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.095471 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.095569 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.095778 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.095862 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.096078 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.096160 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.096379 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.096601 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.097156 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.097250 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.097250 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.097392 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.097536 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.097627 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.097889 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.097990 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.098211 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.098299 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.098535 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.098619 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:44:58.098869 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.098959 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.099191 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.099281 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.099510 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.099660 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.099826 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.099911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.100150 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.100240 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.100500 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.100655 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.100808 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.100901 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.101131 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.101229 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.101468 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.101558 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.101908 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.101996 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.102143 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.102238 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.102468 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.102552 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.102779 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.102873 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.103102 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.103196 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.103416 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.103502 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.103745 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.103827 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.104062 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.104225 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.104383 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.104475 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.104704 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.104795 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.105016 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.105114 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.105333 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.105428 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.105656 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.105747 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.106000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.106102 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.106315 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.106408 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.106654 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.106737 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.106970 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.107061 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.107379 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.107489 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.107676 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.107771 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.107995 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.108083 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.108305 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.108399 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.108616 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.108700 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.108928 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.109028 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.109250 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.109335 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.109573 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.109668 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.109908 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.109996 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.110225 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.110309 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.110540 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.110636 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.110856 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.110945 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.111166 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.111257 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.111478 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.111606 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.111787 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.111874 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.112101 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.112265 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.112497 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.112942 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.113026 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.113026 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.113166 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.113322 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.113408 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.113653 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.113740 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.113991 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.114087 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.114306 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.114398 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.114618 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.114742 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.114926 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.115073 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.115322 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.115469 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.115559 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.115638 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.115856 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.115940 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.116170 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.116263 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.116558 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.116653 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.116795 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.116882 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.117124 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.117218 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.117438 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.117523 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.117754 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.117893 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.118092 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.118189 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.118401 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.118499 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.118716 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.118808 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.119022 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.119106 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.119336 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.119420 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.119647 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.119730 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.119957 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.120050 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.120269 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.120360 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.120578 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.120669 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.120895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.120982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.121209 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.121293 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.121518 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.121600 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.121858 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.121946 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.122179 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.122263 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.122492 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.122603 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.122814 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.122904 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.123129 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.123227 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.123438 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.123536 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.123754 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.123838 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.124070 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.124162 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.124383 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.124476 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.124983 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.125115 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.125304 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.125388 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.125617 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.125715 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.125959 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.126045 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.126316 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.126403 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.126629 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.126716 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.126939 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.127031 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.127271 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.127356 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.127577 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.127661 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.127933 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.128167 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.128661 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.128759 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.128849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.128929 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.129014 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.129094 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.129171 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.129397 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.129496 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.129701 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.129864 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.130035 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.130201 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.130344 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.130508 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.130671 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.130826 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.131057 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.131133 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.131396 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.131481 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.131707 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.131835 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.132016 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.132109 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.132364 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.132456 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.132671 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.132755 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.132994 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.133076 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.133320 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.133406 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.133637 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.133723 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.134011 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.134186 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.134329 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.134421 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.134651 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.134736 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.134991 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.135097 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.135288 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.135387 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.135613 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.135709 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.135936 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.136066 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.136261 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.136380 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.136583 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.136669 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.136905 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.136997 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.137220 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.137304 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.137541 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.137625 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.137885 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.137973 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.138201 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.138292 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.138521 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.138611 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.138858 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.139012 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.139163 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.139246 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.139486 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.139586 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.139809 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.139895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.140147 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.140232 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.140458 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.140544 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.140775 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.140860 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.141082 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.141202 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.141393 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.141479 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.141707 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.141834 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.142048 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.142149 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.142379 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.142528 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.142694 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.142801 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.143013 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.143099 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.143454 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.143620 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.143754 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.143899 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.144071 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.144160 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.144280 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.144374 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.144670 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.144755 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.144986 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.145071 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.145321 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.145464 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.145661 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.145756 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.146009 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.146095 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.146323 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.146409 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.146645 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.146747 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.146961 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.147070 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.147272 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.147357 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.147580 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.147664 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.147900 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.147985 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.148206 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.148292 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.148515 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.148599 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.148831 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.148924 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.149143 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.149229 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.149454 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.149543 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.149766 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.149932 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.150115 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.150202 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.150434 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.150522 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.150746 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.150850 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.151054 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.151139 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.151360 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.151486 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.151690 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.151788 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.152003 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.152121 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.152315 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.152401 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.152636 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.152728 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.152941 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.153091 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.153246 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.153342 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.153569 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.153669 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.153914 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.154003 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.154221 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.154314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.154528 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.154615 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.154835 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.154930 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.155146 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.155230 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.155463 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.155582 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.155780 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.155864 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.156091 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.156173 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.156404 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.156497 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.156712 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.156796 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.157029 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.157113 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.157337 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.157422 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.157646 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.157730 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.157977 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.158100 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.158289 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.158419 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.158610 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.158731 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.159177 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.159281 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.159967 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160149 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160229 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160305 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160382 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160468 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160547 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160670 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160756 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.160996 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.161140 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.161319 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.161410 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.161655 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.161729 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.162027 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.162133 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.162336 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.162436 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.162644 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.162939 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.163031 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.163252 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.163344 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.163577 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.163661 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.163879 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.163962 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.164189 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.164283 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.164506 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.164598 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.164818 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.164902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.165126 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.165226 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.165441 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.165525 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.165749 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.165903 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.166086 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.166172 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.166398 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.166483 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.166706 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.166797 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.167017 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.167100 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.167326 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.167424 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.167625 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.167717 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.167930 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.168014 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.168239 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.168332 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.168543 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.168632 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.168846 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.168941 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.169150 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.169235 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.169453 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.169536 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.169767 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.169886 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.170092 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.170177 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.170411 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.170502 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.170715 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.170807 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.171038 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.171122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.171347 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.171433 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.171654 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.171783 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.171958 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.172042 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.172262 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.172381 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.172603 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.172691 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.172906 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.172989 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.173212 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.173296 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.173528 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.173614 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.173867 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.173970 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.174184 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.174269 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.174500 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.174693 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.174848 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.175308 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.175399 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.175487 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.175566 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.175690 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.175829 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.176002 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.176093 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.176321 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.176412 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.176634 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.176719 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.176942 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.177026 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.177258 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.177343 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.177565 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.177649 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.177906 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.178001 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.178212 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.178299 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.178533 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.178617 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.178842 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.178934 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.179150 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.179234 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.179458 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.179557 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.179770 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.179862 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.180077 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.180162 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.180383 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.180465 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.180690 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.180787 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.181000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.181084 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.181305 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.181389 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.181610 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.181702 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.181935 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.182019 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.182242 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.182325 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.182548 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.182634 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.182853 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.182937 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.183159 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.183243 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.183467 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.183552 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.183776 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.183860 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.184078 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.184162 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.184383 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.184475 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.184691 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.184775 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.184994 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.185078 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.185299 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.185383 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.185604 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.185686 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.185928 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.186026 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.186234 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.186320 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.186539 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.186630 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.186845 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.186939 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.187162 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.187261 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.187467 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.187550 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.187775 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.187937 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.188078 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.188171 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.188382 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.188466 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.188688 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.188784 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.188998 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.189090 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.189302 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.189386 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.189605 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.189689 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.189931 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.190019 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.190295 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.190431 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191016 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191107 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191186 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191264 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191341 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191418 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191503 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191699 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.191827 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.192008 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.192141 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.192315 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.192458 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.192699 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.192787 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.193059 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.193143 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.193382 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.193475 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.193697 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.193799 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.194041 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.194138 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.194362 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.194452 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.194677 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.194760 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.194992 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.195075 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.195296 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.195386 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.195607 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.195696 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.195922 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.196049 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.196230 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.196314 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.196543 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.196627 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.196847 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.196938 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.197152 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.197236 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.197467 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.197563 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.197825 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.197963 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.198096 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.198235 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.198413 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.198524 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.198724 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.198842 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.199045 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.199349 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.199658 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.199971 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.200094 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.200279 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.200418 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.200589 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.200732 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.200898 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.201064 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.201209 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.201382 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.201521 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.201695 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.201856 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.202040 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.202173 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.202351 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.202486 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.202666 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.202795 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.202974 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.203104 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.203412 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.203496 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.203719 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.203803 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.204035 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.204125 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.204344 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.204427 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.204651 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.204735 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.204960 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.205055 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.205267 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.205351 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.205583 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.205675 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.205967 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.206277 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.206722 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.206808 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.206894 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.206981 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.207061 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.207216 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.207301 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.207530 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.207614 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.207850 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.207935 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.208168 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.208251 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.208495 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.208611 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.208800 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.208893 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.209109 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.209194 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.209415 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.209529 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.209739 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.209874 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.210072 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.210194 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.210396 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.210494 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.210817 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.210899 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.211117 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.211201 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.211421 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.211513 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.211744 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.211827 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.212053 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.212137 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.212367 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.212460 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.212675 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.212800 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.212999 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.213084 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.213307 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.213393 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.213631 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.213716 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.213984 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.214069 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.214298 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.214383 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.214627 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.214711 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.214954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.215076 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.215268 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.215402 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.215582 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.215713 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.215897 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.216037 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.216216 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.216362 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.216555 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.216687 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.216870 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.216995 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.217192 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.217311 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.217610 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.217708 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.217961 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.218046 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.218277 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.218373 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.218592 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.218676 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.218907 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.218992 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.219213 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.219304 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.219521 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.219606 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.219831 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.219957 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.220138 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.220237 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.220445 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.220532 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.220778 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.220862 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.221091 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.221188 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.221413 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.221599 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.221756 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.221930 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.222118 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.222286 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.222376 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.222549 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.222698 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.222827 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.222985 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.223175 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.223308 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.223474 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.223617 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.223844 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.224050 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.224149 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.224244 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.224494 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.224638 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.224809 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.224964 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.225124 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.225323 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.225416 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.225504 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.225736 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.225896 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.226068 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.226201 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.226359 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.226450 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.226668 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.226759 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.226997 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.227088 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.227311 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.227401 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.227635 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.227725 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.227957 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.228064 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.228270 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.228366 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.228601 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.228701 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.228900 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.229015 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.229227 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.229325 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.229533 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.229622 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.229854 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.230014 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.230218 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.230335 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.230523 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.230613 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.230845 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.230935 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.231173 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.231271 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.231481 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.231577 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.231785 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.231882 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.232081 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.232176 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.232388 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.232481 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.232695 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.232782 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.233000 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.233095 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.233326 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.233412 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.233629 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.233713 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.233977 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.234299 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.234415 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.234614 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.234711 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.234923 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.235031 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.235231 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.235352 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.235582 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.235673 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.235886 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.236064 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.236200 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.236286 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.236511 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.236609 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.236818 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.236904 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.237253 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.237722 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.238186 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.238516 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.238845 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.239199 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.239522 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.239654 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.239812 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.239902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.240139 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.240258 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.240462 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.240567 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.240773 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.240867 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.241093 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.241181 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.241415 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.241501 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.241737 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.241868 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.242145 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.242355 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.242548 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.242693 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.242834 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.243013 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.243173 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.243334 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.243536 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.243638 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.243848 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.243952 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.244180 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.244284 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.244508 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.244607 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.244835 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.245006 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.245164 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.245243 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.245479 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.245562 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.245825 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.245919 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.246154 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.246237 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.246477 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.246561 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.246796 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.246884 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.247122 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.247197 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.247441 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.247524 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.247763 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.247838 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.248081 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.248328 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.248446 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.248665 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.248751 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.248987 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.249074 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.249499 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.249618 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.250029 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.250116 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.250313 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.250463 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.250602 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.250701 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.250916 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.251003 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.251233 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.251320 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.251548 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.251732 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.251887 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.251981 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.252209 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.252339 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.252498 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.252586 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.252933 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.253096 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.253310 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.253412 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.253608 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.253756 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.253953 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.254115 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.254285 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.254434 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.254613 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.254749 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.254982 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.255116 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.255316 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.255602 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.255733 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.255939 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.256076 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.256241 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.256383 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.256559 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.256694 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.256885 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.257072 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.257201 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.257308 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.257518 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.257605 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.257856 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.257947 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.258172 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.258272 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.258484 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.258572 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.258805 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.258920 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.259120 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.259247 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.259432 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.259575 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.259758 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.259913 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.260074 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.260239 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.260383 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.260558 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.260715 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.260878 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.261035 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.261202 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.261594 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.261845 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.261975 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.262151 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.262299 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.262491 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.262639 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.262826 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.262969 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.263154 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.263295 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.263473 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.263609 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.263793 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.263957 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.264125 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.264257 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.264433 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.264572 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.264741 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.264878 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.265059 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.265189 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.265370 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.265508 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.265677 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.265838 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.266026 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.266116 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.266338 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.266424 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.266646 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.266741 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.266967 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.267099 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.267274 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.267359 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.267604 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.267809 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.267898 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.268163 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.268249 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.268604 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.268717 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.268951 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.269039 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.269271 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.269387 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.269572 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.269659 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.269907 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.269999 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.270219 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.270311 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.270544 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.270643 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.270852 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.270938 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.271164 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.271257 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.271475 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.271570 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.271791 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.271877 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.272097 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.272183 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.272576 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.272968 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.272968 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.273141 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.273227 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.273315 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.273401 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.273489 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.273690 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.273943 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.274031 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.274278 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.274374 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.274592 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.274677 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.274977 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.275169 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.275293 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.275508 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.275646 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.275814 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.275997 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.276108 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.276431 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.276571 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.276746 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.276914 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.277063 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.277242 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.277380 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.277584 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.277675 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.277947 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.278037 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.278265 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.278365 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.278578 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.278665 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.278889 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.278974 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.279204 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.279302 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.279606 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.279729 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.279845 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.279997 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.280163 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.280310 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.280480 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.280621 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.280794 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.280941 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.281110 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.281254 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.281426 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.281580 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.281741 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.281919 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.282087 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.282237 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.282403 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.282587 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.282717 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.282908 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.283074 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.283417 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.283507 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.283739 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.283831 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.284177 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.284289 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.284500 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.284679 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.284823 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.285021 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.285144 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.285336 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.285466 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.285654 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.285825 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.285989 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.286130 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.286319 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.286446 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.286635 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.286763 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.286956 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.287087 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.287271 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.287422 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.287587 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.287740 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.287899 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.288050 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.288211 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.288482 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.288569 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.288801 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.288896 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.289117 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.289203 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.289427 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.289512 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.289737 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.289862 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.290072 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.290168 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.290381 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.290467 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.290699 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.290838 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.291021 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.291107 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.291337 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.291432 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.291660 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.291758 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.291981 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.292075 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.292303 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.292389 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.292617 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.292704 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.292933 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.293027 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.293240 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.293325 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.293551 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.293644 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.293892 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.293994 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.294226 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.294331 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.294538 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.294631 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.294850 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.294945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.295150 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.295292 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.295468 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.295617 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.295787 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.295936 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.296103 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.296259 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.296412 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.296570 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.296722 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.296890 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.297035 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.297214 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.297341 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.297528 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.297649 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.297872 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.297995 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.298186 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.298303 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.298518 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.298612 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.298859 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.298955 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.299188 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.299281 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.299502 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.299590 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.299919 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.300028 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.300179 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.300447 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.300534 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.300757 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.301151 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.301387 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.301497 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.301689 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.301810 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.302029 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.302134 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.302336 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.302430 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.302640 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.302726 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.302951 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.303048 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.303257 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.303352 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.303563 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.303650 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.303868 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.303963 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.304177 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.304283 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.304481 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.304569 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.304785 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.304872 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.305089 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.305177 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.305487 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.305700 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.305818 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.306027 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.306125 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.306330 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.306416 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.306640 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.306736 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.306944 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.307030 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.307247 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.307384 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.307551 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.307650 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.307855 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.307983 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.308157 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.308309 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.308489 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.308637 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.308824 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.308961 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.309143 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.309279 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.309465 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.309612 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.309838 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.309957 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.310124 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.310273 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.310433 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.310594 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.310757 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.310911 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.311081 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.311228 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.311400 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.311549 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.311709 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.311869 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.312046 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.312200 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.312359 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.312531 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.312673 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.312846 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.312990 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.313178 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.313303 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.313509 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.313615 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.313897 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.314000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.314216 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.314303 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.314570 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.314660 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.314884 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.314979 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.315212 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.315319 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.315553 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.315639 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.315868 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.315963 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.316125 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 15:44:58.316241 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.316564 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.316902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.317221 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.317537 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.317888 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.318210 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.318529 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.318855 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.319179 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.319522 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.319857 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.320174 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.320510 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.320842 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.321200 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.321522 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.321921 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.322257 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.322584 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.322902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.323213 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:44:58.323459 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 15:44:58.473067 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO dbcounter [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Registered counter for database nova_api Jun 21 15:44:58.483027 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO dbcounter [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Registered counter for database nova_api Jun 21 15:44:58.494891 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_db.sqlalchemy.engines [None req-31363007-b8f1-4301-9080-7e2895da797d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:44:58.501874 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writer thread running {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:44:58.503538 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG oslo_db.sqlalchemy.engines [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:44:58.510133 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writer thread running {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:44:58.560653 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.context [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb9b484-66dd-44e4-a1fd-b11b99b80367(cell1) {{(pid=109600) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 15:44:58.564549 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:44:58.566421 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:44:58.567251 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:44:58.569190 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:44:58.569322 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.context [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb9b484-66dd-44e4-a1fd-b11b99b80367(cell1) {{(pid=109601) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 15:44:58.571240 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO dbcounter [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Registered counter for database nova_cell0 Jun 21 15:44:58.573799 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG oslo_concurrency.lockutils [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:44:58.575353 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO dbcounter [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Registered counter for database nova_cell1 Jun 21 15:44:58.575560 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG oslo_concurrency.lockutils [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:44:58.576409 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG oslo_concurrency.lockutils [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:44:58.578602 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG oslo_concurrency.lockutils [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:44:58.580822 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO dbcounter [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Registered counter for database nova_cell0 Jun 21 15:44:58.583800 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_db.sqlalchemy.engines [None req-31363007-b8f1-4301-9080-7e2895da797d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:44:58.585288 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_db.sqlalchemy.engines [None req-31363007-b8f1-4301-9080-7e2895da797d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:44:58.586762 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO dbcounter [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Registered counter for database nova_cell1 Jun 21 15:44:58.592451 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writer thread running {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:44:58.593983 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writer thread running {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:44:58.595421 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG oslo_db.sqlalchemy.engines [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:44:58.599984 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG oslo_db.sqlalchemy.engines [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:44:58.602214 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writer thread running {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:44:58.744531 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO dbcounter [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Registered counter for database nova_cell0 Jun 21 15:44:58.754447 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writer thread running {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:44:58.756199 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_db.sqlalchemy.engines [None req-31363007-b8f1-4301-9080-7e2895da797d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:44:58.761072 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writer thread running {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:44:58.765455 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO dbcounter [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Registered counter for database nova_cell0 Jun 21 15:44:58.777103 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG oslo_db.sqlalchemy.engines [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:44:58.782881 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writer thread running {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:44:59.111653 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: WARNING keystonemiddleware.auth_token [None req-31363007-b8f1-4301-9080-7e2895da797d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 15:44:59.116224 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: WARNING keystonemiddleware.auth_token [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 15:44:59.119152 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: WARNING keystonemiddleware.auth_token [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 15:44:59.123548 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: WARNING keystonemiddleware.auth_token [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 15:44:59.480961 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: WARNING keystonemiddleware.auth_token [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 15:44:59.485820 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: WARNING keystonemiddleware.auth_token [None req-31363007-b8f1-4301-9080-7e2895da797d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 15:44:59.488146 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: WARNING keystonemiddleware.auth_token [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 15:44:59.492377 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: WARNING keystonemiddleware.auth_token [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 15:44:59.493899 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563960bf89c0 pid: 109601 (default app) Jun 21 15:44:59.496055 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:44:59.497288 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-e90f6806-c519-4c0c-a216-de0c5da1225c None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001807 Jun 21 15:44:59.497596 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563960bf89c0 pid: 109600 (default app) Jun 21 15:44:59.497707 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Jun 21 15:44:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:17.387022 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:17.388836 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-31363007-b8f1-4301-9080-7e2895da797d None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002561 Jun 21 15:46:17.389394 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:17.402687 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writing DB stats nova_api:SELECT=3 {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:17.403642 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writing DB stats nova_cell0:SELECT=3 {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:17.404864 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writing DB stats nova_cell1:SELECT=3 {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:17.405520 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writing DB stats nova_cell0:SELECT=3 {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:17.874464 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-30a21127-6406-4f53-9848-2d1b47933c43 admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:17.905197 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-30a21127-6406-4f53-9848-2d1b47933c43 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.507993 Jun 21 15:46:17.905690 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jun 21 15:46:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:46:19.995215 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-31363007-b8f1-4301-9080-7e2895da797d None None] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:19.996223 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-31363007-b8f1-4301-9080-7e2895da797d None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 21 15:46:19.996600 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:20.058949 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-b22069ec-8afb-43bb-a4ee-892f12fa2145 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:20.077502 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:46:20.077502 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: warnings.warn(msg) Jun 21 15:46:20.111650 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-b22069ec-8afb-43bb-a4ee-892f12fa2145 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108037 Jun 21 15:46:20.112236 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:20.331072 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-0395b62d-36a0-4541-8dc7-401e5493daae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:20.333409 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:46:20.333409 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 21 15:46:20.336134 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=3 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:20.336905 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell1:SELECT=3 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:20.338086 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell0:SELECT=3 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:20.338797 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:20.406071 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-0395b62d-36a0-4541-8dc7-401e5493daae admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284142 Jun 21 15:46:20.409842 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jun 21 15:46:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:46:22.553296 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-b22069ec-8afb-43bb-a4ee-892f12fa2145 admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:22.554345 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-b22069ec-8afb-43bb-a4ee-892f12fa2145 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 21 15:46:22.554778 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:22.661459 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-8c9244f7-798f-4a39-bca4-753bb8e5b4a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:22.678999 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:46:22.678999 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 21 15:46:22.700623 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-8c9244f7-798f-4a39-bca4-753bb8e5b4a2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139865 Jun 21 15:46:22.701305 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:22.714007 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-edcef97a-49d8-4ad2-99bd-8cdab7babaa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:22.715610 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:46:22.715610 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: warnings.warn(msg) Jun 21 15:46:22.752133 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-edcef97a-49d8-4ad2-99bd-8cdab7babaa0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042010 Jun 21 15:46:22.752851 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jun 21 15:46:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:46:24.834109 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-8c9244f7-798f-4a39-bca4-753bb8e5b4a2 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:24.835761 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-8c9244f7-798f-4a39-bca4-753bb8e5b4a2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Jun 21 15:46:24.836336 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:24.899999 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-de2fb4d2-2c1d-4111-9575-c932cde82a4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "vcpus": 1, "swap": 0, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:24.920622 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-de2fb4d2-2c1d-4111-9575-c932cde82a4a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078186 Jun 21 15:46:24.921510 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 15:46:24.933680 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-90299381-a8bc-42b6-aa34-45c2dcad31d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:24.958089 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-90299381-a8bc-42b6-aa34-45c2dcad31d9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028044 Jun 21 15:46:24.959065 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jun 21 15:46:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:46:27.132657 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-de2fb4d2-2c1d-4111-9575-c932cde82a4a admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:27.133698 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-de2fb4d2-2c1d-4111-9575-c932cde82a4a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 21 15:46:27.134152 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:27.206298 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-46f6e305-7192-4951-98be-1aafdb04b5b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "name": "ds2G", "disk": 10, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:27.225326 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-46f6e305-7192-4951-98be-1aafdb04b5b9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084750 Jun 21 15:46:27.226185 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:27.239022 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-727a9581-a4bc-43de-b1f2-95c8bb9d86fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:27.265531 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-727a9581-a4bc-43de-b1f2-95c8bb9d86fc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031129 Jun 21 15:46:27.266275 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jun 21 15:46:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:46:29.337341 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-46f6e305-7192-4951-98be-1aafdb04b5b9 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:29.338393 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-46f6e305-7192-4951-98be-1aafdb04b5b9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 21 15:46:29.338794 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:29.402404 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-f26ae5ec-bbc4-43a0-9a19-841d580de12a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "ram": 4096, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:29.425620 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-f26ae5ec-bbc4-43a0-9a19-841d580de12a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080842 Jun 21 15:46:29.426201 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:29.438714 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-91a4c342-4f88-4773-ac5d-cec8bfafe72c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:29.465709 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-91a4c342-4f88-4773-ac5d-cec8bfafe72c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031156 Jun 21 15:46:29.466349 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jun 21 15:46:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:46:31.573323 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-f26ae5ec-bbc4-43a0-9a19-841d580de12a admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:31.574384 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-f26ae5ec-bbc4-43a0-9a19-841d580de12a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 21 15:46:31.574753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:31.638709 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-f7fa790f-f34f-4a2f-a3e3-24b8bbb5dbfa admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:31.664653 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-f7fa790f-f34f-4a2f-a3e3-24b8bbb5dbfa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082589 Jun 21 15:46:31.665326 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jun 21 15:46:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:46:33.779626 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-f26ae5ec-bbc4-43a0-9a19-841d580de12a admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:33.780587 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-f26ae5ec-bbc4-43a0-9a19-841d580de12a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Jun 21 15:46:33.781062 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:33.841729 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-5d808843-185b-457f-b233-9b88ec6ae399 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:33.861551 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-5d808843-185b-457f-b233-9b88ec6ae399 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074255 Jun 21 15:46:33.862161 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:33.875712 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-6ae10172-c4b1-4fb7-92ea-a8bc9f333adc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:33.904807 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-6ae10172-c4b1-4fb7-92ea-a8bc9f333adc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033441 Jun 21 15:46:33.905430 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jun 21 15:46:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:46:36.033598 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-5d808843-185b-457f-b233-9b88ec6ae399 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:36.034696 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-5d808843-185b-457f-b233-9b88ec6ae399 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jun 21 15:46:36.035067 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:36.102963 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-05792ee6-0550-4c5d-b883-dcdc2e7da6de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:36.127276 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-05792ee6-0550-4c5d-b883-dcdc2e7da6de admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085671 Jun 21 15:46:36.127920 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 15:46:36.140654 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-34e1773f-0c05-4958-ad6d-4b4149e8bb73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:36.166010 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-34e1773f-0c05-4958-ad6d-4b4149e8bb73 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029095 Jun 21 15:46:36.166557 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jun 21 15:46:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:46:38.371053 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-05792ee6-0550-4c5d-b883-dcdc2e7da6de admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:38.372164 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-05792ee6-0550-4c5d-b883-dcdc2e7da6de admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jun 21 15:46:38.373193 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:38.452627 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-e39ff35e-61e6-4467-b97d-bbc4383bd4b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:38.475752 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-e39ff35e-61e6-4467-b97d-bbc4383bd4b0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.095861 Jun 21 15:46:38.476379 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:38.491712 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-5f33baac-3c8c-4bd4-8275-9944f263fd38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:38.522065 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-5f33baac-3c8c-4bd4-8275-9944f263fd38 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035247 Jun 21 15:46:38.528649 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jun 21 15:46:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:46:40.627196 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-e39ff35e-61e6-4467-b97d-bbc4383bd4b0 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:40.628571 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-e39ff35e-61e6-4467-b97d-bbc4383bd4b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jun 21 15:46:40.628943 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:40.689392 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-1c501693-ddf5-43fa-be60-0b3e5e3d26d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large"}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:40.709750 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-1c501693-ddf5-43fa-be60-0b3e5e3d26d6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074696 Jun 21 15:46:40.710321 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 15:46:40.722325 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-dc054486-6375-4e94-b45c-98918d9009e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:40.747074 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-dc054486-6375-4e94-b45c-98918d9009e4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028538 Jun 21 15:46:40.748109 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jun 21 15:46:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:46:42.854977 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-1c501693-ddf5-43fa-be60-0b3e5e3d26d6 admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:46:42.855860 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-1c501693-ddf5-43fa-be60-0b3e5e3d26d6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 21 15:46:42.856295 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:46:42.922584 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-c355c507-b511-4911-bb9e-edbe10098db7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:42.943698 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-c355c507-b511-4911-bb9e-edbe10098db7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080933 Jun 21 15:46:42.944425 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jun 21 15:46:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:42.957072 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-9599f87d-6733-412c-ba80-6082b5ecb2c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:46:42.982051 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-9599f87d-6733-412c-ba80-6082b5ecb2c2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029213 Jun 21 15:46:42.982536 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jun 21 15:46:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:47:07.847068 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-c355c507-b511-4911-bb9e-edbe10098db7 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:07.848068 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-c355c507-b511-4911-bb9e-edbe10098db7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 21 15:47:07.848871 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:07.859298 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:07.913003 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-5e0de848-202d-4f27-a3da-b1ee3b6e301b admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:07.930459 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-5e0de848-202d-4f27-a3da-b1ee3b6e301b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075726 Jun 21 15:47:07.931004 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jun 21 15:47:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:47:08.869485 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-c355c507-b511-4911-bb9e-edbe10098db7 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:08.870530 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-c355c507-b511-4911-bb9e-edbe10098db7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 21 15:47:08.870944 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:47:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:09.082794 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-be7d4a96-62e7-4c90-bcd9-608b2dd2c4d9 admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:09.088542 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.wsgi [None req-be7d4a96-62e7-4c90-bcd9-608b2dd2c4d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-be7d4a96-62e7-4c90-bcd9-608b2dd2c4d9 admin admin] Request method failure captured: Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Accept: application/json Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Accept-Encoding: gzip, deflate Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Connection: keep-alive Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Content-Length: 0 Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Host: 10.222.0.52 Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Openstack-Api-Version: compute 2.90 Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Openstack-System-Scope: None Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: User-Agent: python-novaclient Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Auth-Token: gAAAAABisef8TbH7KEPR0PlbQCNhOVX8EOOyVqwpz1asSCAzvT8iw63E9iL6hr5-QEt_gVsV6kj0Cej7Lo8J9DLa130vhFKGPB4AisBKNs8vAesqDa6a5-JhMkWnrmL1Ybt05xfZ7O4JFxF0pZrg-ImWoWXsr12GzHJWqXPN_s6IYrV6g6yKdJQ Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Domain-Id: None Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Domain-Name: None Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Identity-Status: Confirmed Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Is-Admin-Project: True Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Domain-Id: default Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Domain-Name: Default Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Name: admin Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Role: admin,reader,member Jun 21 15:47:09.091902 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Roles: admin,reader,member Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb46a2622cdd481281f00889cb2ab74f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant: admin Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant-Name: admin Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User: admin Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Domain-Id: default Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Domain-Name: Default Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Id: 945ae273f8ef413cad49cd7331140c10 Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Name: admin Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: method: > Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: exception: Flavor 42 could not be found. Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: action_args: {'id': '42'} Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:47:09.094196 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:09.095420 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.096773 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-be7d4a96-62e7-4c90-bcd9-608b2dd2c4d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:47:09.098116 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-be7d4a96-62e7-4c90-bcd9-608b2dd2c4d9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.077657 Jun 21 15:47:09.098116 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jun 21 15:47:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 15:47:09.103449 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-547367ea-d355-4f40-8770-f00805f00d14 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:09.106433 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:09.127083 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-547367ea-d355-4f40-8770-f00805f00d14 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027270 Jun 21 15:47:09.127591 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jun 21 15:47:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:47:09.137850 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-cf3d3116-7116-49bb-b714-db3b38da498d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:09.159968 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-cf3d3116-7116-49bb-b714-db3b38da498d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025742 Jun 21 15:47:09.160506 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jun 21 15:47:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:47:09.174197 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-1ccbc440-5034-41c0-a5c8-f7a633421377 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:09.182189 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.wsgi [None req-1ccbc440-5034-41c0-a5c8-f7a633421377 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-1ccbc440-5034-41c0-a5c8-f7a633421377 admin admin] Request method failure captured: Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Accept: application/json Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Accept-Encoding: gzip, deflate Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Connection: keep-alive Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Content-Length: 0 Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Host: 10.222.0.52 Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Openstack-Api-Version: compute 2.90 Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Openstack-System-Scope: None Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: User-Agent: python-novaclient Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Auth-Token: gAAAAABisef8TbH7KEPR0PlbQCNhOVX8EOOyVqwpz1asSCAzvT8iw63E9iL6hr5-QEt_gVsV6kj0Cej7Lo8J9DLa130vhFKGPB4AisBKNs8vAesqDa6a5-JhMkWnrmL1Ybt05xfZ7O4JFxF0pZrg-ImWoWXsr12GzHJWqXPN_s6IYrV6g6yKdJQ Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Domain-Id: None Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Domain-Name: None Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Identity-Status: Confirmed Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Is-Admin-Project: True Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Domain-Id: default Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Domain-Name: Default Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Name: admin Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Role: admin,reader,member Jun 21 15:47:09.186958 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Roles: admin,reader,member Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb46a2622cdd481281f00889cb2ab74f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant: admin Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant-Name: admin Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User: admin Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Domain-Id: default Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Domain-Name: Default Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Id: 945ae273f8ef413cad49cd7331140c10 Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Name: admin Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: method: > Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: exception: Flavor 42 could not be found. Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: action_args: {'id': '42'} Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:47:09.188954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:09.189945 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:09.191122 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-1ccbc440-5034-41c0-a5c8-f7a633421377 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:47:09.192088 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-1ccbc440-5034-41c0-a5c8-f7a633421377 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.021498 Jun 21 15:47:09.192088 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jun 21 15:47:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 15:47:10.028519 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-cf3d3116-7116-49bb-b714-db3b38da498d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:10.029566 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-cf3d3116-7116-49bb-b714-db3b38da498d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 21 15:47:10.029995 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:47:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:10.222631 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-211910a6-cca6-402d-b48d-5047be586d9b admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:10.228774 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.wsgi [None req-211910a6-cca6-402d-b48d-5047be586d9b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-211910a6-cca6-402d-b48d-5047be586d9b admin admin] Request method failure captured: Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Accept: application/json Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Accept-Encoding: gzip, deflate Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Connection: keep-alive Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Content-Length: 0 Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Host: 10.222.0.52 Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Openstack-Api-Version: compute 2.90 Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Openstack-System-Scope: None Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: User-Agent: python-novaclient Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Auth-Token: gAAAAABisef-M2zIFhG9wq987UA3iCSxeDkv9v9gq97Goh-aTJ1cx86N1l0zeDAKfLkx8-XnLm1kIJfOhTeHWwytZqpDOxtp7xRBw7t7mUPogA4Gy45A4Jx5c2PSlcPMmewZ2F7UAN_J0CcgBUCMy0BKZRhriGWlXkDrPuE7Wb2CdUP_85unlfg Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Domain-Id: None Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Domain-Name: None Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Identity-Status: Confirmed Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Is-Admin-Project: True Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Domain-Id: default Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Domain-Name: Default Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Name: admin Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Role: admin,reader,member Jun 21 15:47:10.230354 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Roles: admin,reader,member Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb46a2622cdd481281f00889cb2ab74f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant: admin Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant-Name: admin Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User: admin Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Domain-Id: default Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Domain-Name: Default Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Id: 945ae273f8ef413cad49cd7331140c10 Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Name: admin Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: method: > Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: exception: Flavor 84 could not be found. Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: action_args: {'id': '84'} Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:47:10.231849 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:10.232772 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.233982 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-211910a6-cca6-402d-b48d-5047be586d9b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:47:10.235002 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-211910a6-cca6-402d-b48d-5047be586d9b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064175 Jun 21 15:47:10.235002 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jun 21 15:47:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 15:47:10.242014 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-e2be7323-4134-46ef-9703-5ce930453606 admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:10.257926 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-e2be7323-4134-46ef-9703-5ce930453606 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019510 Jun 21 15:47:10.258485 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jun 21 15:47:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:47:10.268584 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-a30de0e9-56ec-4a5c-b70e-980c77385df5 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:10.284475 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-a30de0e9-56ec-4a5c-b70e-980c77385df5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019457 Jun 21 15:47:10.285000 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jun 21 15:47:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:47:10.294689 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-2e2d6f95-8880-4250-be95-fea167fd2720 admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:10.300338 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.wsgi [None req-2e2d6f95-8880-4250-be95-fea167fd2720 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-2e2d6f95-8880-4250-be95-fea167fd2720 admin admin] Request method failure captured: Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Accept: application/json Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Accept-Encoding: gzip, deflate Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Connection: keep-alive Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Content-Length: 0 Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Host: 10.222.0.52 Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Openstack-Api-Version: compute 2.90 Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Openstack-System-Scope: None Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: User-Agent: python-novaclient Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Auth-Token: gAAAAABisef-M2zIFhG9wq987UA3iCSxeDkv9v9gq97Goh-aTJ1cx86N1l0zeDAKfLkx8-XnLm1kIJfOhTeHWwytZqpDOxtp7xRBw7t7mUPogA4Gy45A4Jx5c2PSlcPMmewZ2F7UAN_J0CcgBUCMy0BKZRhriGWlXkDrPuE7Wb2CdUP_85unlfg Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Domain-Id: None Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Domain-Name: None Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Identity-Status: Confirmed Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Is-Admin-Project: True Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Domain-Id: default Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Domain-Name: Default Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Name: admin Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Role: admin,reader,member Jun 21 15:47:10.301911 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Roles: admin,reader,member Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb46a2622cdd481281f00889cb2ab74f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant: admin Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant-Name: admin Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User: admin Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Domain-Id: default Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Domain-Name: Default Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Id: 945ae273f8ef413cad49cd7331140c10 Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Name: admin Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: method: > Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: exception: Flavor 84 could not be found. Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: action_args: {'id': '84'} Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:47:10.303195 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:10.303966 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:10.305000 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-2e2d6f95-8880-4250-be95-fea167fd2720 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:47:10.306029 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-2e2d6f95-8880-4250-be95-fea167fd2720 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012191 Jun 21 15:47:10.306029 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jun 21 15:47:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 21 15:47:11.136378 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-a30de0e9-56ec-4a5c-b70e-980c77385df5 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:11.137496 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-a30de0e9-56ec-4a5c-b70e-980c77385df5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Jun 21 15:47:11.137969 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:47:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:11.337597 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-380aa0ed-4566-458a-ab22-e4246d282acc admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:11.344160 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.wsgi [None req-380aa0ed-4566-458a-ab22-e4246d282acc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-380aa0ed-4566-458a-ab22-e4246d282acc admin admin] Request method failure captured: Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Accept: application/json Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Accept-Encoding: gzip, deflate Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Connection: keep-alive Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Content-Length: 0 Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Host: 10.222.0.52 Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Openstack-Api-Version: compute 2.90 Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Openstack-System-Scope: None Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: User-Agent: python-novaclient Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Auth-Token: gAAAAABisef_4-Fvcfuwt-WX_bUBcyjJH4HRFMRF4ne2G0Tw5fD01f_EBqg2DWrm4j1oZaMEDpxmAwketSPDXYaF_by9ybu_XJ6O79TjYJ25zrhjlC7OOuCqXlmAPzCnfxtQNwhkcCJDvfGn_Et8N9uQyKsNNNtcImsaQG0t4BmoYTq1SGzTwBw Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Domain-Id: None Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Domain-Name: None Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Identity-Status: Confirmed Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Is-Admin-Project: True Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Domain-Id: default Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Domain-Name: Default Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Project-Name: admin Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Role: admin,reader,member Jun 21 15:47:11.345895 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Roles: admin,reader,member Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb46a2622cdd481281f00889cb2ab74f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant: admin Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-Tenant-Name: admin Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User: admin Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Domain-Id: default Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Domain-Name: Default Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Id: 945ae273f8ef413cad49cd7331140c10 Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: X-User-Name: admin Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: method: > Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: exception: Flavor 451 could not be found. Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: action_args: {'id': '451'} Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:47:11.347753 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:11.348603 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.349950 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-380aa0ed-4566-458a-ab22-e4246d282acc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:47:11.351186 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-380aa0ed-4566-458a-ab22-e4246d282acc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068431 Jun 21 15:47:11.351186 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jun 21 15:47:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 15:47:11.357332 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-62bca577-bfc4-4bee-a25b-6e2aa6bc9a01 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:11.371619 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-62bca577-bfc4-4bee-a25b-6e2aa6bc9a01 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017955 Jun 21 15:47:11.372168 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jun 21 15:47:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:47:11.382818 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:11.398539 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019314 Jun 21 15:47:11.398990 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jun 21 15:47:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:47:11.409551 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-5c1b1f9c-004d-496b-8adf-f427cd4f0104 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:11.415643 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.wsgi [None req-5c1b1f9c-004d-496b-8adf-f427cd4f0104 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-5c1b1f9c-004d-496b-8adf-f427cd4f0104 admin admin] Request method failure captured: Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Accept: application/json Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Accept-Encoding: gzip, deflate Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Connection: keep-alive Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Content-Length: 0 Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Host: 10.222.0.52 Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Openstack-Api-Version: compute 2.90 Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Openstack-System-Scope: None Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: User-Agent: python-novaclient Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Auth-Token: gAAAAABisef_4-Fvcfuwt-WX_bUBcyjJH4HRFMRF4ne2G0Tw5fD01f_EBqg2DWrm4j1oZaMEDpxmAwketSPDXYaF_by9ybu_XJ6O79TjYJ25zrhjlC7OOuCqXlmAPzCnfxtQNwhkcCJDvfGn_Et8N9uQyKsNNNtcImsaQG0t4BmoYTq1SGzTwBw Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Domain-Id: None Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Domain-Name: None Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Identity-Status: Confirmed Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Is-Admin-Project: True Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Domain-Id: default Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Domain-Name: Default Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Project-Name: admin Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Role: admin,reader,member Jun 21 15:47:11.418314 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Roles: admin,reader,member Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb46a2622cdd481281f00889cb2ab74f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb46a2622cdd481281f00889cb2ab74f", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant: admin Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant-Id: eb46a2622cdd481281f00889cb2ab74f Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-Tenant-Name: admin Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User: admin Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Domain-Id: default Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Domain-Name: Default Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Id: 945ae273f8ef413cad49cd7331140c10 Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: X-User-Name: admin Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: method: > Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: exception: Flavor 451 could not be found. Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: action_args: {'id': '451'} Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:47:11.421710 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:11.422672 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 21 15:47:11.423859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-5c1b1f9c-004d-496b-8adf-f427cd4f0104 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:47:11.425352 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-5c1b1f9c-004d-496b-8adf-f427cd4f0104 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014641 Jun 21 15:47:11.425352 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jun 21 15:47:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 15:47:12.257175 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:12.258248 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Jun 21 15:47:12.258672 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:12.458329 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-b0bca9cc-a3e2-4553-a17e-9e2c89b20c6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:47:12.483463 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-b0bca9cc-a3e2-4553-a17e-9e2c89b20c6e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081409 Jun 21 15:47:12.483904 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jun 21 15:47:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 15:47:13.369581 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:13.370690 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jun 21 15:47:13.371083 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:47:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:13.564633 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-826f8758-8d22-47e8-8b90-4ed53dd0d31f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:47:13.582797 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-826f8758-8d22-47e8-8b90-4ed53dd0d31f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072660 Jun 21 15:47:13.583438 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jun 21 15:47:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:47:14.428644 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:14.430285 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002177 Jun 21 15:47:14.430782 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:47:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:14.629398 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-17c0fad3-e76d-4651-b46b-672c1d7f2f3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:47:14.648075 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-17c0fad3-e76d-4651-b46b-672c1d7f2f3a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.079381 Jun 21 15:47:14.648617 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jun 21 15:47:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:47:15.506968 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:15.507980 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 21 15:47:15.508458 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:15.722636 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-40f499bc-74ec-4be3-a97b-19934a3d3424 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:47:15.741916 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-40f499bc-74ec-4be3-a97b-19934a3d3424 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.083049 Jun 21 15:47:15.742404 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jun 21 15:47:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:47:16.565830 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:16.567097 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 21 15:47:16.567310 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:47:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:47:16.769081 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-d584a458-69d6-4cc1-8043-1d01337ea76f admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:47:16.793859 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-d584a458-69d6-4cc1-8043-1d01337ea76f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.089418 Jun 21 15:47:16.794336 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Jun 21 15:47:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:48:04.629893 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:48:04.631388 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-ff19daa3-4886-44bf-9a9b-062bfb5ed90d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001836 Jun 21 15:48:04.631918 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jun 21 15:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:48:04.642954 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:04.698561 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-b2d90e2d-3ae2-4a21-9bec-dbdbaec82dc0 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:48:04.718023 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-b2d90e2d-3ae2-4a21-9bec-dbdbaec82dc0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079927 Jun 21 15:48:04.718537 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jun 21 15:48:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:48:04.745662 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-2fddb771-f34a-4e93-8e83-3afb5933273a admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:48:04.749801 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG dbcounter [-] [109601] Writing DB stats nova_api:SELECT=14 {{(pid=109601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:04.756574 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-2fddb771-f34a-4e93-8e83-3afb5933273a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014827 Jun 21 15:48:04.757155 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1282 bytes} [Tue Jun 21 15:48:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:48:04.769809 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-30e29b53-6aec-4ddb-ada1-36eca705a14e admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:48:04.778111 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-30e29b53-6aec-4ddb-ada1-36eca705a14e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012237 Jun 21 15:48:04.778670 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1285 bytes} [Tue Jun 21 15:48:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:48:04.791427 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:48:04.799701 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012418 Jun 21 15:48:04.800230 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1285 bytes} [Tue Jun 21 15:48:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:48:04.812099 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-1e87375c-4b4b-411a-8cf1-34a84651ae08 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:48:04.820450 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-1e87375c-4b4b-411a-8cf1-34a84651ae08 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011941 Jun 21 15:48:04.821025 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1282 bytes} [Tue Jun 21 15:48:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:51:26.243076 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:51:26.244089 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Jun 21 15:51:26.244490 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:51:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:51:26.391623 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=6 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:26.521907 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-b43f25f1-4fd6-437c-be54-aa05a7ac8f7e admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:51:26.523511 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:51:26.523511 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 21 15:51:26.525112 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-b43f25f1-4fd6-437c-be54-aa05a7ac8f7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:51:26.525700 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-b43f25f1-4fd6-437c-be54-aa05a7ac8f7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:51:26.526754 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-b43f25f1-4fd6-437c-be54-aa05a7ac8f7e admin admin] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:51:26.527367 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-b43f25f1-4fd6-437c-be54-aa05a7ac8f7e admin admin] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:51:26.564630 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-b43f25f1-4fd6-437c-be54-aa05a7ac8f7e admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.174378 Jun 21 15:51:26.565187 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 35/70] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jun 21 15:51:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:51:27.438759 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:51:27.439776 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 21 15:51:27.440169 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:51:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:51:27.634045 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-8653793a-e530-4881-82ba-0f0491430626 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:51:27.635218 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:51:27.635218 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 21 15:51:27.636393 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-8653793a-e530-4881-82ba-0f0491430626 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:51:27.636830 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-8653793a-e530-4881-82ba-0f0491430626 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:51:27.637617 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-8653793a-e530-4881-82ba-0f0491430626 admin admin] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:51:27.638065 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-8653793a-e530-4881-82ba-0f0491430626 admin admin] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:51:27.658342 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-8653793a-e530-4881-82ba-0f0491430626 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078611 Jun 21 15:51:27.658898 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jun 21 15:51:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:51:38.938131 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:51:38.939238 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Jun 21 15:51:38.939628 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:51:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:51:39.083295 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell0:SELECT=4 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:39.084101 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell1:SELECT=4 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:39.084698 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=8 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:39.141194 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-48dcbef5-f5cc-42e4-95ef-350cd5352967 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:51:39.142340 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:51:39.142340 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 21 15:51:39.143531 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-48dcbef5-f5cc-42e4-95ef-350cd5352967 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:51:39.143973 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-48dcbef5-f5cc-42e4-95ef-350cd5352967 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:51:39.144746 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-48dcbef5-f5cc-42e4-95ef-350cd5352967 admin admin] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:51:39.145690 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-48dcbef5-f5cc-42e4-95ef-350cd5352967 admin admin] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:51:39.171756 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-48dcbef5-f5cc-42e4-95ef-350cd5352967 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.092963 Jun 21 15:51:39.172304 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 37/74] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jun 21 15:51:39 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:51:40.003991 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: DEBUG nova.api.openstack.wsgi [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] Calling method '>' {{(pid=109601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:51:40.005679 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: INFO nova.api.openstack.requestlog [None req-7bae882d-706a-4982-a4e1-7e6bd05fc61e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002109 Jun 21 15:51:40.006120 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: [pid: 109601|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jun 21 15:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:51:40.203888 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-58c9426c-a4dc-4207-b08a-80f7bf70af41 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:51:40.205045 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:51:40.205045 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 21 15:51:40.206381 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-58c9426c-a4dc-4207-b08a-80f7bf70af41 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:51:40.207013 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-58c9426c-a4dc-4207-b08a-80f7bf70af41 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:51:40.208168 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-58c9426c-a4dc-4207-b08a-80f7bf70af41 admin admin] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:51:40.208837 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-58c9426c-a4dc-4207-b08a-80f7bf70af41 admin admin] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:51:40.230886 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-58c9426c-a4dc-4207-b08a-80f7bf70af41 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081711 Jun 21 15:51:40.231447 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 38/76] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jun 21 15:51:40 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:52:37.711580 dv-cinder-840678-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 15:52:37.712147 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: Tue Jun 21 15:52:37 2022 - graceful shutdown triggered... Jun 21 15:52:37.712634 dv-cinder-840678-13-iscsi devstack@n-api.service[109600]: Gracefully killing worker 1 (pid: 109600)... Jun 21 15:52:37.713018 dv-cinder-840678-13-iscsi devstack@n-api.service[109601]: Gracefully killing worker 2 (pid: 109601)... Jun 21 15:52:38.713516 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: worker 1 buried after 1 seconds Jun 21 15:52:38.713516 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: worker 2 buried after 1 seconds Jun 21 15:52:38.713516 dv-cinder-840678-13-iscsi devstack@n-api.service[109599]: goodbye to uWSGI. Jun 21 15:52:38.715631 dv-cinder-840678-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 15:52:38.716359 dv-cinder-840678-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 15:52:38.719979 dv-cinder-840678-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 15:52:38.732663 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 15:52:38.736264 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 15:52:38 2022] *** Jun 21 15:52:38.736476 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 15:52:38.736649 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 15:52:38.736796 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: nodename: dv-cinder-840678-13-iscsi Jun 21 15:52:38.736947 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: machine: x86_64 Jun 21 15:52:38.737243 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: clock source: unix Jun 21 15:52:38.737409 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: pcre jit disabled Jun 21 15:52:38.737551 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: detected number of CPU cores: 4 Jun 21 15:52:38.737690 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: current working directory: / Jun 21 15:52:38.737853 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: detected binary path: /usr/bin/uwsgi-core Jun 21 15:52:38.738004 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: your processes number limit is 47680 Jun 21 15:52:38.738173 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: your memory page size is 4096 bytes Jun 21 15:52:38.738319 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: detected max file descriptor number: 2048 Jun 21 15:52:38.738472 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: lock engine: pthread robust mutexes Jun 21 15:52:38.739164 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: thunder lock: enabled Jun 21 15:52:38.739553 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 15:52:38.739867 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 15:52:38.786087 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: Python main interpreter initialized at 0x55f69374f9c0 Jun 21 15:52:38.786087 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: python threads support enabled Jun 21 15:52:38.786087 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: your server socket listen backlog is limited to 100 connections Jun 21 15:52:38.786087 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: your mercy for graceful operations on workers is 90 seconds Jun 21 15:52:38.786568 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 15:52:38.786568 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: *** Operational MODE: preforking *** Jun 21 15:52:38.786803 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: *** uWSGI is running in multiple interpreter mode *** Jun 21 15:52:38.786803 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: spawned uWSGI master process (pid: 123918) Jun 21 15:52:38.787020 dv-cinder-840678-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 15:52:38.787699 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: spawned uWSGI worker 1 (pid: 123938, cores: 1) Jun 21 15:52:38.787979 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: spawned uWSGI worker 2 (pid: 123939, cores: 1) Jun 21 15:52:38.788103 dv-cinder-840678-13-iscsi devstack@n-api.service[123918]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 15:52:39.452645 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 15:52:39.461804 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 15:52:40.655447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:52:40.655447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: from cryptography.utils import int_from_bytes Jun 21 15:52:40.656061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:52:40.656061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: from cryptography.utils import int_from_bytes Jun 21 15:52:40.673851 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:52:40.673851 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: from cryptography.utils import int_from_bytes Jun 21 15:52:40.674425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:52:40.674425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: from cryptography.utils import int_from_bytes Jun 21 15:52:43.055699 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 15:52:43.056453 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 15:52:43.056453 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 15:52:43.056997 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 15:52:43.057126 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 15:52:43.057497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.057860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.058189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.058561 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.058897 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.059207 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.059532 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.059885 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.060213 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.060442 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.060838 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.061167 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-13-iscsi {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.061490 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.061798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.062159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.062479 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.062786 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.063080 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.063388 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.063935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.065569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.065569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.065569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.065569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.065569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.066131 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.066417 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.066542 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.066864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.067200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.067612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-13-iscsi {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.067891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.068222 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.068520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.068966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.069244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.069558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.069912 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.070228 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.070539 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.070869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.071198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.071510 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.071857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.072210 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.072464 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.072853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.073145 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.073451 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.073764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.074034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.074342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.074699 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.075021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.075345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.075570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.075834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.076156 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.076478 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.076767 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.077075 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.077367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.077673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.078023 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.078327 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.078630 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.078941 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.079260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.079587 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.079913 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.080205 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.080541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.080955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.081202 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.081502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.081879 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.082220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.082525 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.082833 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.083172 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.083477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.083769 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.084093 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.084394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.084747 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.085177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.086133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.086133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.086133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.086996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.086996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.086996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.087544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.087544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.087827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.088214 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.088578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.088889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.089472 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.089472 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.089953 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.090102 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.090401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.090747 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.091060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.091375 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.091677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.091963 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.092278 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.092779 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.093091 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.093391 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.093723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.094074 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.094387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.094703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.095020 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.095314 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.095635 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.095962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.096246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.096562 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.096868 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.097163 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.097481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.097817 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.098114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.098441 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.098728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.099032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.099330 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.099652 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.099973 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.100283 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.100581 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.100879 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.101196 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.101542 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.101900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.102247 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.102540 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.102886 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.103240 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.103698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.104085 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.104506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.104734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.106408 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.106734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.107039 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.107370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.107694 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.108037 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.108358 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.108713 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.108998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.109155 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 15:52:43.109766 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 15:52:43.110074 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.110074 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.110570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 15:52:43.111010 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.111415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 15:52:43.111621 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.111849 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 15:52:43.112122 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.112528 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.112935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.113164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.113941 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.114181 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.114390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.114584 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.114851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.115000 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.115161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.115600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.115841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.116071 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.116303 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.116512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.116661 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.116829 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.116829 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.117160 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.117342 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.117588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.117891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-13-iscsi {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.118061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.118274 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.118502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.118737 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.120146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.120463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.120712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.120876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.121165 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.121655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.121956 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.122201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.122457 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.122854 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.123126 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.123126 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.123593 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.124004 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.124248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.124492 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.124739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.125120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.125382 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.125637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.126001 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.126169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.126323 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.126466 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.126619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.126845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.127074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.127304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.127304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.127748 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.127974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.127974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.128258 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.128258 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.128536 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.128536 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.128823 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-13-iscsi {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.128973 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.129117 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.129264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.129420 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.129574 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.129731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.129932 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.130103 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.130373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.130535 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.130686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.130828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.130982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.131152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.131423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.131776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.131933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.132086 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.132241 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.132390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.132532 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.132684 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.132946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.133114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.133369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.133516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.133672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.133843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.134150 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.134301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.134301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.134587 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.134861 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.135130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.135433 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.135592 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.135747 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.135889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.136060 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.136340 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.136497 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.136647 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.136791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.136791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.137088 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.137231 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.137383 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.137525 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.137668 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.137865 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.138016 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.138158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.138300 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.138448 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.138605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.138760 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.139050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.139219 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.139373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.139516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.139677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.139831 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.139980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.140123 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.140264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.140432 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.140432 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.140868 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.141023 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.141163 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.141304 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.141588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.141982 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.142135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.142135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.142411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.142553 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.142703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.142853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.143128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.143300 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.143578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.143726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.143868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.144009 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.144181 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.144445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.144445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.144721 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.144869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.144869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.144869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.145287 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.145555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.145704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.145891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.146045 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.146186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.146345 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.146620 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.146779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.146779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.147067 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.147218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.147367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.147509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.147668 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.147823 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.148021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.148173 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.148315 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.148463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.148612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.148769 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.148955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.149102 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.149251 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.149401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.149541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.149716 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.149896 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.150089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.150262 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.150262 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.150586 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.150764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.151046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.151193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.151193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.151787 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.152187 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.152424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.152584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.152584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.153101 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.153346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.153346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.153759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.153993 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.154149 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.154292 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.154292 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.154706 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.154862 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.154862 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.155152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.155293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.155293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.155746 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.155894 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.155894 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.156171 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.156312 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.156461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.156637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.156907 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.157061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.157307 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.157452 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.157744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.157939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.158085 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.158227 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.158383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.158532 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.158532 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.158800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.158948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.159102 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.159254 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.159414 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.159556 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.159705 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.159864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.160017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.160166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.160166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.160166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.160576 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.160718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.160874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.161044 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.161295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.161455 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.161597 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.161762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.162023 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.162345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.162512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.162656 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.162805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.162945 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.163095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.163237 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.163481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.163631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.163888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.164045 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.164189 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.164335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.164477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.164617 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.164863 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.165023 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.165174 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.165324 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.165474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.165624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.166022 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.166192 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.166520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.166671 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.166830 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.167112 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.167260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.167416 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.167560 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.167701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.167850 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.168000 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.168156 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.168319 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.168461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:52:43.168461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.168787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.168787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.169084 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.169227 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.169377 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.169519 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.169667 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.169859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.170034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.170188 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.170349 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.170496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.170652 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.170819 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.170969 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.171123 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.171298 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.171575 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.171730 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.171894 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.172176 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.172537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.172713 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.172871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.173020 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.173181 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.173332 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.173506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.173762 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.174077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.174241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.174405 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.174555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.174709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.174877 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.175146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.175314 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.175471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.175620 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.175767 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.175943 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.176188 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.176350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.176498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.176648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.176795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.176953 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.177130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.177130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.177570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.177728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.177923 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.178081 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.178239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.178396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.178396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.178802 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.178964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.179127 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.179292 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.179460 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.179622 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.179779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.179944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.180104 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.180262 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.180418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.180566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.180739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.181089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.181247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.181396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.181614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.181981 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.182189 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.182754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.182955 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.183150 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.183343 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.183536 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.183856 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.184307 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.184515 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.184716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.184880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.185096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.185400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.185566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.185725 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.185904 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.186055 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.186243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.186243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.186710 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.186710 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.187036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.187036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.187421 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.187720 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.187900 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.187900 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.188233 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.188233 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.188563 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.188563 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.188887 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.189066 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.189246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.189423 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.189606 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.189890 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.190109 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.190335 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.190503 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.190673 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.190871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.191042 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.191215 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.191393 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.191583 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.191745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.191904 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.192190 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.192345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.192621 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.192982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.193152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.193309 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.193465 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.193615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.193790 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.194006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.194191 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.194540 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.194705 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.194864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.195015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.195175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.195338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.195614 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.195776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.195943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.199753 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.199970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.200154 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.200342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.200504 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.200659 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.200823 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.200986 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.201153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.201303 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.201460 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.201618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.201812 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.202103 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.202425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.202600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.202875 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.203302 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.203460 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.203621 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.203790 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.203938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.204087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.204234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.204393 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.204787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.204942 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.205091 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.205365 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.205543 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.205860 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.206093 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.206260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.206433 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.206592 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.206757 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.206927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.207086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.207261 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.207528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.207710 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.207845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.207999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.208130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.208269 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.208407 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.208548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.208714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.208864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.209072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.209216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.209381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.209539 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.210030 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.210188 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.210317 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.210444 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.210577 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.210715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.210853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.210981 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.211114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.211242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.211368 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.211494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.211630 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.211759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.211885 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.212011 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.212152 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.212317 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.212710 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.212929 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.213315 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.213596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.213736 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.213954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.214087 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.214222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.214350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.214477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.214960 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.215113 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.215243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.215382 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.215517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.215646 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.215773 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.216041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.216180 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.216317 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.216445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.216580 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.216759 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.216898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.217035 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.217163 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.217289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.217415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.217556 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.217692 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.217834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.217963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.218089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.218216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219247 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219384 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.219520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.220776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.220776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.220776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.220776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.220776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.220776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.220776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.220776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.221797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.221797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.221797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.221797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.221797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.221797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.221797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.221797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.223120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.223120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.223120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.223120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.223120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.223120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.223120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.223120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.224722 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.225220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.225359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.225496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.225639 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.225850 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226014 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226251 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.226390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.227391 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.227523 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.227667 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.227804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.227933 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.228070 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.228206 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.228335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.228739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.228739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.228994 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.229132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.229269 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.229404 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.229404 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.229653 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.229797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.229943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.230134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.230279 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.230546 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.230546 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.230814 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.230951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.231086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.231221 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.231580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.231712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.231921 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.232060 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.232060 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.232318 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.232446 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.232537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.232626 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.232626 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.232951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.233026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.233026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.233162 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.233250 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.233330 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.237895 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.237895 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.238085 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.238193 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.238283 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.238377 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.238463 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.238888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.238977 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239164 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239409 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239493 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239684 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239867 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.239867 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.240026 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.240121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.240121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.240290 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.240383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.240383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.240847 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.240946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241033 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241117 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241117 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.241999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242093 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242180 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242180 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242539 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242626 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242802 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242802 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.242970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.243056 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.243148 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.243239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.243325 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.243424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.243516 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.244395 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.244473 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.244555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.244636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.244721 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.244802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.244888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.244962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245192 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245265 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245506 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245589 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245663 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.245742 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.246509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.246584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.246670 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.246755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.246755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.246893 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.246974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.247046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.247117 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.247571 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.247883 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.247989 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248063 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248205 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248205 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248345 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248424 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248504 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248575 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248727 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248804 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248883 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.248975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249053 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249738 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.249843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250192 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250561 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.250816 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251157 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251580 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251663 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251848 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.251934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252203 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252372 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.252980 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253064 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253154 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253248 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253339 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253431 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253515 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253599 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.253963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.254058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.254159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.254580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.254696 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.254784 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.254868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.254951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.255042 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.255134 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.255307 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.255403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.255541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.255633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.256227 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.256334 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.256422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.256514 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.256650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.256739 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.256823 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.256918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257188 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257280 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257441 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257526 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.257946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258109 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258193 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258275 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258357 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258455 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258632 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258721 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258721 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.258987 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259163 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259328 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259642 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.259942 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260067 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260168 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260251 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260333 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260492 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260654 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260727 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260811 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.260898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.261356 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.261356 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.261644 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.261644 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.261880 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.261983 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.262124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.262247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.262359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.262477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.262598 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.262716 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.262716 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.262943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263067 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263179 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263406 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263754 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263865 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.263974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.264094 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.264205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.264322 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.264663 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.264903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265020 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265379 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265491 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265737 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265885 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.265999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.266108 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.266218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.266327 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.266450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.266568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.266686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.266838 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.266974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.267166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.267293 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.267505 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.267641 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.267831 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.267948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.268148 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.268284 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.268463 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.268579 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.268781 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.268898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.269128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.269351 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.269457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.269728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.269865 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.270070 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.270184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.270376 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.270476 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.270699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.270877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.271009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.271142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.271395 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.271493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.271618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.271764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.271938 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.272102 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.272241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.272397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.272556 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.272715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.272992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.273140 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.273277 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.273420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.273569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.273706 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.273994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.274144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.274301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.274453 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.274737 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.274895 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.275042 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.275133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.275250 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.275457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.275796 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.276061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.276145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.276411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.276511 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.276723 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.276816 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.277039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.277189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.277351 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.277455 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.277659 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.277760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.277994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.278096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.278305 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.278397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.278609 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.278700 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.278916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.279007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.279232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.279332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.279533 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.279634 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.279841 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.279942 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.280145 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.280243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.280453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.280557 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.280756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.280849 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.281061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.281201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.281378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.281514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.281686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.281842 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.282050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.282160 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.282358 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.282461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.282665 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.282758 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.282971 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.283072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.283285 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.283378 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.283591 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.283682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.283899 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.284056 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.284207 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.284370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.284513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.284681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.284832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.284991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.285119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.285292 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.285432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.285593 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.285721 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.285923 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.286137 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.286239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.286445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.286544 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.286754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.286860 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.287109 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.287209 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.287428 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.287527 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.287735 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.287838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.288041 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.288132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.288364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.288456 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.288676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.288777 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.289003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.289110 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.289323 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.289450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.289636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.289813 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.290020 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.290113 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.290344 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.290436 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.290699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.290955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.291057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.291300 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.291402 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.291627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.291793 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.291990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.292116 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.292307 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.292418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.292615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.292738 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.292924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.293058 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.293234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.293381 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.293562 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.293715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.293933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.294075 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.294217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.294364 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.294518 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.294669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.294806 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.295121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.295522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.295915 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.296077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.296217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.296368 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.296514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.296651 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.296789 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.296935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.296935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.297194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.297194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.297479 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.297479 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.297759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.297759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.298068 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.298212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.298380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.298527 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.298703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.298920 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.299063 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.299203 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.299349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.299496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.299644 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.299787 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.299954 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.300091 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.300263 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.300418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.300559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.300707 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.300874 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.301024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.301172 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.301333 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.301488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.301647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.301847 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.302033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.302288 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.302438 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.302588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.302738 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.302879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.303026 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.303255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.303396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.303547 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.303697 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.303847 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.303985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.304135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.304289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.304434 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.304611 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.304939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.305254 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.305455 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.305608 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.305856 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.306018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.306175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.306365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.306544 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.306727 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.306880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.307031 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.307183 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.307336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.307544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.307694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.307858 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.308040 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.308202 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.308433 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.308598 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.308753 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.308895 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.309046 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.309201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.309345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.309494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.309637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.309827 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.310126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.310435 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.310745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.311017 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.311113 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.311349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.311441 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.311654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.311745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.311961 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.312056 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.312351 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.312494 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.312588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.312673 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.312882 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.312976 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.313194 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.313295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.313506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.313599 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.313841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.313984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.314154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.314289 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.314463 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.314582 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.314898 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.315036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.315156 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.315389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.315492 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.315581 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.315745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.316061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.316368 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.316489 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.316709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.316831 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.317049 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.317169 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.317370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.317471 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.317703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.317882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.318050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.318144 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.318379 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.318480 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.318698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.318791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.319026 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.319119 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.319343 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.319434 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.319663 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.319764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.319976 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.320112 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.320288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.320381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.320603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.320696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.320916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.321016 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.321231 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.321322 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.321541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.321849 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.321994 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.322253 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.322415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.322741 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.322860 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.323084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.323217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.323390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.323483 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.323706 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.323799 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.324023 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.324130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.324336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.324428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.324649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.324742 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.324960 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.325062 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.325270 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.325385 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.325594 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.325697 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.325939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.326053 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.326255 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.326352 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.326569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.326660 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.326882 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.326983 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.327201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.327301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.327513 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.327612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.327839 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.327938 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.328169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.328303 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.328479 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.328623 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.328808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.328930 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.329139 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.329232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.329494 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.329599 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.329857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.329957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.330180 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.330321 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.330494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.330600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.330808 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.330900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.331121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.331215 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.331428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.331527 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.331672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 15:52:43.331773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.332032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.332344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.332670 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.333005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.333333 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.333647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.333994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.334315 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.334847 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.335162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.335497 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.335825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.336148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.336464 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.336784 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.337113 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.337421 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.337745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.338109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.338469 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.338910 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.339211 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.339523 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.339828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.340150 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.340465 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.341003 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.341360 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.341680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.342036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.342366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.342686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.342999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.343333 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.343642 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.343949 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.344267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.344580 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.344886 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.345194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.345507 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.345845 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.346146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.346455 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.346759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.347088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.347394 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.347697 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.348002 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.348310 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.348612 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.348915 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.349217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.349519 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.349848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.350153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.350463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.350764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.351072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.351376 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.351679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.352722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.352722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.352722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.353008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.353306 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.353767 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.354214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.354512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.354825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.355174 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.355495 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.356041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.356378 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.356699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.357036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.357369 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.357675 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.358004 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.358310 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.358636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.358945 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.359264 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.359569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.359883 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.360194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.360502 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.360814 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.361137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.361430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.361738 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.362070 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.362394 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.362692 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.363004 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.364240 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.364240 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.364481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.364583 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.364891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.365200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.365511 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.365840 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.366153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.366470 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.366803 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.367116 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.367424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.367957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.368278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.368594 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.368918 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.369254 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.369579 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.369930 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.370249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.370568 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.370911 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.371214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.371552 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.371880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.372207 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.372520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.372820 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.373439 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.373754 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.374089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.374394 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.374697 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.375005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.375309 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.375612 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.375912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.376214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.376521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.376822 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.377122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.377424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.377727 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.378050 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.378353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.378660 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.378963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.379267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.379570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.379874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.380188 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.380503 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.380837 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.381158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.381483 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.381805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.382131 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.382440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.382767 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.383094 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.383411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.383722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.384054 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.384367 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.384724 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.385443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.385726 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.386073 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.386392 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.386731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.387062 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.387373 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.387703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.388026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.388351 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.388672 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.388987 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.389320 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.389630 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.390001 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.390286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.390596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.390910 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.391225 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.391541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.391870 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.392199 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.392509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.392843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.393168 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.393529 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.393853 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.394198 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.394526 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.394840 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.395086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO dbcounter [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Registered counter for database nova_api Jun 21 15:52:43.395186 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.395442 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:52:43.395681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 15:52:43.415830 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_db.sqlalchemy.engines [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:52:43.422749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writer thread running {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:52:43.459214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO dbcounter [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Registered counter for database nova_api Jun 21 15:52:43.479834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.context [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb9b484-66dd-44e4-a1fd-b11b99b80367(cell1) {{(pid=123939) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 15:52:43.480074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_db.sqlalchemy.engines [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:52:43.484227 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:52:43.485870 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:52:43.486684 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:52:43.488436 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writer thread running {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:52:43.488972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:52:43.491063 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO dbcounter [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Registered counter for database nova_cell0 Jun 21 15:52:43.495396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO dbcounter [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Registered counter for database nova_cell1 Jun 21 15:52:43.502611 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_db.sqlalchemy.engines [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:52:43.509753 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_db.sqlalchemy.engines [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:52:43.514122 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writer thread running {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:52:43.549936 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.context [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ecb9b484-66dd-44e4-a1fd-b11b99b80367(cell1) {{(pid=123938) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 15:52:43.554221 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:52:43.555845 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:52:43.557091 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:52:43.559084 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:52:43.561188 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO dbcounter [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Registered counter for database nova_cell0 Jun 21 15:52:43.565475 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO dbcounter [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Registered counter for database nova_cell1 Jun 21 15:52:43.573521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_db.sqlalchemy.engines [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:52:43.580624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_db.sqlalchemy.engines [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:52:43.585069 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writer thread running {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:52:43.662125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writer thread running {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:52:43.673004 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO dbcounter [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Registered counter for database nova_cell0 Jun 21 15:52:43.679755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_db.sqlalchemy.engines [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:52:43.684531 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writer thread running {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:52:43.734921 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writer thread running {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:52:43.744993 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO dbcounter [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Registered counter for database nova_cell0 Jun 21 15:52:43.752067 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_db.sqlalchemy.engines [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:52:43.757091 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writer thread running {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:52:44.002122 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: WARNING keystonemiddleware.auth_token [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 15:52:44.010346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: WARNING keystonemiddleware.auth_token [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 15:52:44.085597 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: WARNING keystonemiddleware.auth_token [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 15:52:44.093757 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: WARNING keystonemiddleware.auth_token [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 15:52:44.363285 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: WARNING keystonemiddleware.auth_token [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 15:52:44.370166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: WARNING keystonemiddleware.auth_token [None req-832af275-681f-4914-a108-a36b6a7838f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 15:52:44.375720 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f69374f9c0 pid: 123939 (default app) Jun 21 15:52:44.452536 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: WARNING keystonemiddleware.auth_token [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 15:52:44.458628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: WARNING keystonemiddleware.auth_token [None req-20e553c1-cc75-4a9b-ae20-7cfffe29043b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 15:52:44.464218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f69374f9c0 pid: 123938 (default app) Jun 21 15:53:26.209843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:26.212226 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:26.213123 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:26.214085 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:27.331547 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d9fece3e-b392-4096-a30e-ee04f61bfe52 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Action: 'create', calling method: .version_select at 0x7f73b7ddc700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-942367720"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:28.899494 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d9fece3e-b392-4096-a30e-ee04f61bfe52 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.711572 Jun 21 15:53:28.900143 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1154 bytes} [Tue Jun 21 15:53:26 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2714 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 21 15:53:29.263120 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4e417496-1b22-41d8-be46-f29d9a057435 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7e8e280>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:29.322167 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:29.324101 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:29.326731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:29.329080 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:29.948292 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4e417496-1b22-41d8-be46-f29d9a057435 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226" status: 200 len: 344 microversion: 2.1 time: 1.037175 Jun 21 15:53:29.948978 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:28 2022] GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 => generated 344 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:30.963723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-671e9606-9c6b-474e-9157-a500d43c88ef tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7ca0550>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:31.038425 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-671e9606-9c6b-474e-9157-a500d43c88ef tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226" status: 200 len: 345 microversion: 2.1 time: 0.079127 Jun 21 15:53:31.039264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:30 2022] GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:31.052646 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f2ae461f-8628-4403-bdba-bf63185ff557 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Action: 'create', calling method: .version_select at 0x7f73b7ce5310>, body: {"snapshot": {"volume_id": "85e4ee7c-f577-4fdc-82b7-c91acf4be226", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1876612407"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:31.418559 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f2ae461f-8628-4403-bdba-bf63185ff557 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.371539 Jun 21 15:53:31.419545 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 2/4] 10.222.0.52 () {60 vars in 1161 bytes} [Tue Jun 21 15:53:31 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:31.430630 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-aad5dbbe-4a4a-4e8a-9d3b-44368fd2bb9f tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7ca08b0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:31.636154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-aad5dbbe-4a4a-4e8a-9d3b-44368fd2bb9f tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 200 len: 287 microversion: 2.1 time: 0.210121 Jun 21 15:53:31.636911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:31 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 287 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:31.647453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-acd694e7-3eeb-4591-b2ff-5aa2eef8af9c tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7ce5d30>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:31.731440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-acd694e7-3eeb-4591-b2ff-5aa2eef8af9c tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.088629 Jun 21 15:53:31.737479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Jun 21 15:53:31 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:31.745565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d85d224b-2822-497d-ab33-2e7175fd390d tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7ca0dc0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:31.827349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d85d224b-2822-497d-ab33-2e7175fd390d tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 200 len: 287 microversion: 2.1 time: 0.084738 Jun 21 15:53:31.827349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:31 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:32.847509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-10744ebd-13ab-4ae1-a3d1-44ae1597835d tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7caca60>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:32.957247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-10744ebd-13ab-4ae1-a3d1-44ae1597835d tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 200 len: 287 microversion: 2.1 time: 0.121434 Jun 21 15:53:32.958225 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:32 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:33.970502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c1fee121-75ba-4b53-b852-ce222b7f2769 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7cb64c0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:34.026737 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c1fee121-75ba-4b53-b852-ce222b7f2769 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 200 len: 287 microversion: 2.1 time: 0.060799 Jun 21 15:53:34.027582 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:33 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:35.040575 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c01e76a2-606f-44fb-8c33-4ef43c09349f tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7cac8b0>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:35.122040 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c01e76a2-606f-44fb-8c33-4ef43c09349f tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 200 len: 287 microversion: 2.1 time: 0.085157 Jun 21 15:53:35.122839 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:35 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:36.136495 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d8f71045-86bc-49c6-a26c-44a2fecad2b0 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7ca0d30>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:36.213225 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d8f71045-86bc-49c6-a26c-44a2fecad2b0 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 200 len: 287 microversion: 2.1 time: 0.081508 Jun 21 15:53:36.213968 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:36 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:37.225697 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2f082992-4b84-4729-b68e-2c113c810e43 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7cac040>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:37.302976 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2f082992-4b84-4729-b68e-2c113c810e43 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 200 len: 288 microversion: 2.1 time: 0.081959 Jun 21 15:53:37.308874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:37 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:37.314484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-32a36811-3480-446e-a980-e8507280bc2a tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7ca0af0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:37.499968 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-32a36811-3480-446e-a980-e8507280bc2a tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 202 len: 0 microversion: 2.1 time: 0.188621 Jun 21 15:53:37.500779 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1253 bytes} [Tue Jun 21 15:53:37 2022] DELETE /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 15:53:37.509389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-287faf03-8a54-4b78-944b-5f407c2c3203 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7ce5e50>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:37.657232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-287faf03-8a54-4b78-944b-5f407c2c3203 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 200 len: 287 microversion: 2.1 time: 0.151796 Jun 21 15:53:37.658173 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 7/14] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:37 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:38.669499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fa11a0c9-b2a0-4244-b627-97e4b1e6807b tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7cb6700>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:39.043273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-fa11a0c9-b2a0-4244-b627-97e4b1e6807b tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] HTTP exception thrown: Snapshot a41e229b-cada-4fcc-bd74-ee4d99014e50 could not be found. Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fa11a0c9-b2a0-4244-b627-97e4b1e6807b tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Request method failure captured: Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 HTTP/1.1 Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisel28ZPyLLlZBU4zdBL7ml4F51YNLwHytzKQ5dzSHRQWEJv17pXe6dqdJOFgwR4cMhRdrn7H5a2PLcZKHKA5S6yHa_5IC4DkMg_8EYYjt3o8nC8c0iOBZmCo1rQ6EekqM9iNpcggFrxEfRweNNgFF3ZH2Yi4bepNz7n5LbMuslytwYQ Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8a626149a0ee4b3db0113c7084b37cfa Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:53:39.055217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a626149a0ee4b3db0113c7084b37cfa", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8a626149a0ee4b3db0113c7084b37cfa Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesSnapshotsTestJSON-925554502-project Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: dd95af9b9bc246d7aa6445e25e39a7db Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-925554502-project Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Snapshot a41e229b-cada-4fcc-bd74-ee4d99014e50 could not be found. Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'a41e229b-cada-4fcc-bd74-ee4d99014e50'} Jun 21 15:53:39.056239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a41e229b-cada-4fcc-bd74-ee4d99014e50 could not be found. (HTTP 404) (Request-ID: req-55f3d05a-fb52-4835-a7ea-59aa8c798c58) Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:39.056843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 15:53:39.057734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a41e229b-cada-4fcc-bd74-ee4d99014e50 could not be found. Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 15:53:39.058851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a41e229b-cada-4fcc-bd74-ee4d99014e50 could not be found. Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a41e229b-cada-4fcc-bd74-ee4d99014e50 could not be found. Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fa11a0c9-b2a0-4244-b627-97e4b1e6807b tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Returning 404 to user: Snapshot a41e229b-cada-4fcc-bd74-ee4d99014e50 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:53:39.062760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fa11a0c9-b2a0-4244-b627-97e4b1e6807b tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50" status: 404 len: 111 microversion: 2.1 time: 0.392087 Jun 21 15:53:39.067704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 8/15] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jun 21 15:53:38 2022] GET /compute/v2.1/os-snapshots/a41e229b-cada-4fcc-bd74-ee4d99014e50 => generated 111 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:53:39.072171 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6c8e3a85-2962-4c10-af2a-fc6dc777c12f tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7cbb0d0>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:39.234520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6c8e3a85-2962-4c10-af2a-fc6dc777c12f tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226" status: 202 len: 0 microversion: 2.1 time: 0.166847 Jun 21 15:53:39.244294 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-92215990-4064-448d-8d12-a5c87b0653f7 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7cb6d30>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:39.244646 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 15:53:39 2022] DELETE /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 15:53:39.392703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-92215990-4064-448d-8d12-a5c87b0653f7 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226" status: 200 len: 344 microversion: 2.1 time: 0.152428 Jun 21 15:53:39.398401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 9/17] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:39 2022] GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:40.407065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4473b784-d59f-41de-ae97-9e778b993583 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7c1e430>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:40.477726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-4473b784-d59f-41de-ae97-9e778b993583 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] HTTP exception thrown: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4473b784-d59f-41de-ae97-9e778b993583 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Request method failure captured: Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 HTTP/1.1 Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisel28ZPyLLlZBU4zdBL7ml4F51YNLwHytzKQ5dzSHRQWEJv17pXe6dqdJOFgwR4cMhRdrn7H5a2PLcZKHKA5S6yHa_5IC4DkMg_8EYYjt3o8nC8c0iOBZmCo1rQ6EekqM9iNpcggFrxEfRweNNgFF3ZH2Yi4bepNz7n5LbMuslytwYQ Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8a626149a0ee4b3db0113c7084b37cfa Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:53:40.484731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a626149a0ee4b3db0113c7084b37cfa", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8a626149a0ee4b3db0113c7084b37cfa Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesSnapshotsTestJSON-925554502-project Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: dd95af9b9bc246d7aa6445e25e39a7db Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-925554502-project Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '85e4ee7c-f577-4fdc-82b7-c91acf4be226'} Jun 21 15:53:40.486357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. (HTTP 404) (Request-ID: req-0bcdf3e5-a1a2-466d-a4ee-a40612707681) Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.487119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 15:53:40.488982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 15:53:40.490601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.492170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.496295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3bdbf1b2-466f-4274-bd54-50b5267dd90a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'create', calling method: .version_select at 0x7f73b7d97700>, body: {"keypair": {"name": "tempest-keypair-1911271104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqEuu5RpPw5ToKJOlet44WtIAyDibAcI0mwShEzNdHRLLxBg8F0LLrI3TAJY4jJdLAZmBnSvXocuw1sUoUnKu3GFwPTcKiT1A/ynrt4Lu8jLP3SHDQKJFzT7Uo4MKHt1g=="}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:40.498221 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4473b784-d59f-41de-ae97-9e778b993583 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Returning 404 to user: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:53:40.499159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4473b784-d59f-41de-ae97-9e778b993583 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226" status: 404 len: 109 microversion: 2.1 time: 0.096756 Jun 21 15:53:40.499651 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 10/18] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:40 2022] GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:53:40.513089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-54a00d7e-ba7b-4a8c-adec-d135edb244ee tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b7cb6dc0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:40.599080 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-3bdbf1b2-466f-4274-bd54-50b5267dd90a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Getting quotas for project 74f35c94371b44c6936b1e713a398f1c. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:53:40.615512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-3bdbf1b2-466f-4274-bd54-50b5267dd90a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Getting quotas for user fa5a48626c934dc2aa4f24002970b6d5 and project 74f35c94371b44c6936b1e713a398f1c. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:53:40.646553 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-54a00d7e-ba7b-4a8c-adec-d135edb244ee tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] HTTP exception thrown: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-54a00d7e-ba7b-4a8c-adec-d135edb244ee tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Request method failure captured: Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: DELETE /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 HTTP/1.1 Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisel28ZPyLLlZBU4zdBL7ml4F51YNLwHytzKQ5dzSHRQWEJv17pXe6dqdJOFgwR4cMhRdrn7H5a2PLcZKHKA5S6yHa_5IC4DkMg_8EYYjt3o8nC8c0iOBZmCo1rQ6EekqM9iNpcggFrxEfRweNNgFF3ZH2Yi4bepNz7n5LbMuslytwYQ Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8a626149a0ee4b3db0113c7084b37cfa Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:53:40.649613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a626149a0ee4b3db0113c7084b37cfa", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8a626149a0ee4b3db0113c7084b37cfa Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesSnapshotsTestJSON-925554502-project Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: dd95af9b9bc246d7aa6445e25e39a7db Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-925554502-project Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '85e4ee7c-f577-4fdc-82b7-c91acf4be226'} Jun 21 15:53:40.650869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. (HTTP 404) (Request-ID: req-787c06db-3bbd-42a9-b47a-5123f0a6eab3) Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.651664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 15:53:40.652768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 15:53:40.653808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.654857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.656263 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-54a00d7e-ba7b-4a8c-adec-d135edb244ee tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Returning 404 to user: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:53:40.657256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-54a00d7e-ba7b-4a8c-adec-d135edb244ee tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226" status: 404 len: 109 microversion: 2.1 time: 0.151265 Jun 21 15:53:40.658425 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 11/19] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 15:53:40 2022] DELETE /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:53:40.667122 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-882f1519-1286-405d-a3c5-a42cfdb968f6 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Calling method '.version_select at 0x7f73b8607b80>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:40.723744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3bdbf1b2-466f-4274-bd54-50b5267dd90a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.490354 Jun 21 15:53:40.725193 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 9/20] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 15:53:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:40.740933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-882f1519-1286-405d-a3c5-a42cfdb968f6 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] HTTP exception thrown: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-882f1519-1286-405d-a3c5-a42cfdb968f6 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Request method failure captured: Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 HTTP/1.1 Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisel28ZPyLLlZBU4zdBL7ml4F51YNLwHytzKQ5dzSHRQWEJv17pXe6dqdJOFgwR4cMhRdrn7H5a2PLcZKHKA5S6yHa_5IC4DkMg_8EYYjt3o8nC8c0iOBZmCo1rQ6EekqM9iNpcggFrxEfRweNNgFF3ZH2Yi4bepNz7n5LbMuslytwYQ Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8a626149a0ee4b3db0113c7084b37cfa Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:53:40.744342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a626149a0ee4b3db0113c7084b37cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a626149a0ee4b3db0113c7084b37cfa", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8a626149a0ee4b3db0113c7084b37cfa Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-925554502 Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesSnapshotsTestJSON-925554502-project Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: dd95af9b9bc246d7aa6445e25e39a7db Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-925554502-project Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '85e4ee7c-f577-4fdc-82b7-c91acf4be226'} Jun 21 15:53:40.745546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. (HTTP 404) (Request-ID: req-b7ea489e-c45c-4b35-ba2d-ef4d8ff94fcd) Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 15:53:40.747338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 15:53:40.748266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. Jun 21 15:53:40.749260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:40.751144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-882f1519-1286-405d-a3c5-a42cfdb968f6 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] Returning 404 to user: Volume 85e4ee7c-f577-4fdc-82b7-c91acf4be226 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:53:40.752336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-882f1519-1286-405d-a3c5-a42cfdb968f6 tempest-VolumesSnapshotsTestJSON-925554502 tempest-VolumesSnapshotsTestJSON-925554502-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226" status: 404 len: 109 microversion: 2.1 time: 0.089861 Jun 21 15:53:40.753371 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 12/21] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:40 2022] GET /compute/v2.1/os-volumes/85e4ee7c-f577-4fdc-82b7-c91acf4be226 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:53:45.528247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b71d0796-8230-4a0a-9c6c-d92f7624aed1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: .version_select at 0x7f73b7c0d280>, body: {"keypair": {"name": "tempest-keypair-149309982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeYAhCToSSK2gPoymd+OqWbu8/RA7Xjd7gv608pE3yCC/j3FreWMyNxHuDuL4lpi5Ui+mnhwWPwyLPjiW/VSQ4tL7JJoB5/fBsaCLIUkdAQ9C3/iT9L/0YbA0iq/HVuXQ=="}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:45.581756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-b71d0796-8230-4a0a-9c6c-d92f7624aed1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for project d20d29454c00499282eb86547eeb4c10. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:53:45.596704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-b71d0796-8230-4a0a-9c6c-d92f7624aed1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for user 9a67a5c4b7034d22b78331b907cc20bc and project d20d29454c00499282eb86547eeb4c10. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:53:45.667046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b71d0796-8230-4a0a-9c6c-d92f7624aed1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.619368 Jun 21 15:53:45.668001 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 10/22] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 15:53:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:46.311586 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-19cc0f86-bad6-4876-b15e-e1208e21b303 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Action: 'create', calling method: .version_select at 0x7f73b7c1e4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-709706968", "metadata": {"Type": "work"}}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:47.163407 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-19cc0f86-bad6-4876-b15e-e1208e21b303 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.244132 Jun 21 15:53:47.164182 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 13/23] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jun 21 15:53:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1246 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 15:53:47.179482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6fdd4b45-1e2f-4bf8-9f41-29c72b0bd64a tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Calling method '.version_select at 0x7f73b73c1f70>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:47.301944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6fdd4b45-1e2f-4bf8-9f41-29c72b0bd64a tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7" status: 200 len: 352 microversion: 2.1 time: 0.122687 Jun 21 15:53:47.301944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 11/24] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:47 2022] GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:48.307772 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-61257525-a456-4ccf-8e46-542f46b57f71 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Calling method '.version_select at 0x7f73b7c1e9d0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:48.402656 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-61257525-a456-4ccf-8e46-542f46b57f71 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7" status: 200 len: 353 microversion: 2.1 time: 0.099883 Jun 21 15:53:48.403531 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 14/25] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:48 2022] GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:48.417750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ef6ecf47-87e1-49ec-957f-1d06eb86b6d1 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Calling method '.version_select at 0x7f73b73c7700>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:48.524612 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ef6ecf47-87e1-49ec-957f-1d06eb86b6d1 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7" status: 200 len: 353 microversion: 2.1 time: 0.114071 Jun 21 15:53:48.525361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 12/26] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:48 2022] GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:53:48.550075 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f1adf8d3-af4a-4fa6-aa57-4166b905c7b5 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Calling method '.version_select at 0x7f73b7c1e820>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:48.751825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f1adf8d3-af4a-4fa6-aa57-4166b905c7b5 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7" status: 202 len: 0 microversion: 2.1 time: 0.205584 Jun 21 15:53:48.756310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 15/27] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 15:53:48 2022] DELETE /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 15:53:48.765427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-49ea914c-064a-4d39-a901-b25b621c03c8 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Calling method '.version_select at 0x7f73b73c1dc0>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:48.910534 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-49ea914c-064a-4d39-a901-b25b621c03c8 tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7" status: 200 len: 352 microversion: 2.1 time: 0.153039 Jun 21 15:53:48.911606 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 13/28] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:48 2022] GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7 => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:53:49.924840 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-38b33214-d28f-443b-9bd9-643124cc0cfd tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Calling method '.version_select at 0x7f73b7cb6c10>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:50.188215 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1408564813", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0812354c-f08e-4f75-b2a2-092d36277eea"}], "security_groups": [{"name": "tempest-securitygroup--639125129"}], "key_name": "tempest-keypair-1911271104", "user_data": "}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:50.384212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-38b33214-d28f-443b-9bd9-643124cc0cfd tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] HTTP exception thrown: Volume 57b773f8-6083-455b-ac66-a5a2bed185e7 could not be found. Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-38b33214-d28f-443b-9bd9-643124cc0cfd tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Request method failure captured: Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7 HTTP/1.1 Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemJnB9zbkUpymrtWfp1pNGGXIVg-o6KZBzytneyFf2sJt0s9lgtEEy52fAH-BcOaJc-63oRTeSlA0wLUNnbVCBLvf8JgzlD46LgUSLa_pC_FUNi61TJovpCLYroHdZK0i2CBx2IZt4SzczootpC_gbPhKIac63gmPoAIdxhathSosY Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: bc9f7f1f0a754ab9b2f6e46c842382e3 Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesGetTestJSON-1591473185 Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:53:50.394878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bc9f7f1f0a754ab9b2f6e46c842382e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc9f7f1f0a754ab9b2f6e46c842382e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc9f7f1f0a754ab9b2f6e46c842382e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bc9f7f1f0a754ab9b2f6e46c842382e3", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesGetTestJSON-1591473185 Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: bc9f7f1f0a754ab9b2f6e46c842382e3 Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesGetTestJSON-1591473185 Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesGetTestJSON-1591473185-project Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 9c1a6ed1058e48dc95d675110f6ae98e Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesGetTestJSON-1591473185-project Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Volume 57b773f8-6083-455b-ac66-a5a2bed185e7 could not be found. Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '57b773f8-6083-455b-ac66-a5a2bed185e7'} Jun 21 15:53:50.396266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 57b773f8-6083-455b-ac66-a5a2bed185e7 could not be found. (HTTP 404) (Request-ID: req-c57f2b52-12bb-403b-b964-87bf0ddce4f9) Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:50.397086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 15:53:50.398640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 57b773f8-6083-455b-ac66-a5a2bed185e7 could not be found. Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 15:53:50.400072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 57b773f8-6083-455b-ac66-a5a2bed185e7 could not be found. Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 57b773f8-6083-455b-ac66-a5a2bed185e7 could not be found. Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-38b33214-d28f-443b-9bd9-643124cc0cfd tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] Returning 404 to user: Volume 57b773f8-6083-455b-ac66-a5a2bed185e7 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-38b33214-d28f-443b-9bd9-643124cc0cfd tempest-VolumesGetTestJSON-1591473185 tempest-VolumesGetTestJSON-1591473185-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7" status: 404 len: 109 microversion: 2.1 time: 0.478530 Jun 21 15:53:50.404672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 16/29] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 15:53:49 2022] GET /compute/v2.1/os-volumes/57b773f8-6083-455b-ac66-a5a2bed185e7 => generated 109 bytes in 482 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:53:50.651573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] validate_networks() for [('0812354c-f08e-4f75-b2a2-092d36277eea', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:53:50.961642 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4e9957c6-92d1-44a6-b328-481e9f18ce02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'create', calling method: .version_select at 0x7f73b7cb6940>, body: {"keypair": {"name": "tempest-keypair-1632838168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvQQHRZgy/f24hrDa0Jiz2tgzJ8USGjxEou5tzNQW0JHyBY/JTl2T8nTyE833hEHpIyIXlC5wsw2PS4bKjGxJntpzhEDqHgjfyawZ1LVfQlH68IAZgKUvTmAMrHZ1bwDQ=="}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:51.087248 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-4e9957c6-92d1-44a6-b328-481e9f18ce02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Getting quotas for project 74f3f5c4b63c45d691e2b66883eda54a. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:53:51.131628 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-4e9957c6-92d1-44a6-b328-481e9f18ce02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Getting quotas for user 75407a21b1fd46e8ba10540fc5a4c30a and project 74f3f5c4b63c45d691e2b66883eda54a. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:53:51.302192 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4e9957c6-92d1-44a6-b328-481e9f18ce02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.869855 Jun 21 15:53:51.307273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 17/30] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Jun 21 15:53:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 875 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 15:53:51.800363 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2011894646", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "networks": [{"uuid": "c241ff8d-0b92-4b1c-b86b-667c25bb868f"}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:52.011791 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] validate_networks() for [('c241ff8d-0b92-4b1c-b86b-667c25bb868f', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:53:53.045291 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:53:53.045839 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:53:53.046700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:53:53.047496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:53:53.048003 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:53:53.085525 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:53.086062 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:53.086927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:53.087393 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:53.153285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Getting quotas for project 74f35c94371b44c6936b1e713a398f1c. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:53:53.161089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Getting quotas for user fa5a48626c934dc2aa4f24002970b6d5 and project 74f35c94371b44c6936b1e713a398f1c. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:53:53.184914 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:53:53.188607 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:53:53.434389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a2d0831c-cae7-4cd3-b75c-29e72de10ad5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.252986 Jun 21 15:53:53.444359 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 14/31] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:53:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 3261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:53:53.459570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1164753755", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cdeeb75-9f47-4354-8a71-6e4a191914df"}], "security_groups": [{"name": "tempest-securitygroup--313323794"}], "key_name": "tempest-keypair-149309982", "user_data": "}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:53.955107 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:53:53.955600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:53:53.956011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:53:53.956420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:53:53.956825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:53:53.975127 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:53.979794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:53.983985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:53.986341 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:54.034474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] validate_networks() for [('5cdeeb75-9f47-4354-8a71-6e4a191914df', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:53:54.100211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Getting quotas for project 707b41a2e0ce4a8abc4e26c88ce94267. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:53:54.112235 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Getting quotas for user 23031b94dc7f47bf8272b266cbe18a8c and project 707b41a2e0ce4a8abc4e26c88ce94267. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:53:54.163088 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:53:54.182857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:53:54.500778 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3e1ba7f8-5362-4c2b-8fd4-93ef9d547e34 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.027194 Jun 21 15:53:54.507732 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 18/32] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:53:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 15:53:54.530094 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c7df7f80-66e9-4f1c-a74d-4c669df2d2fe tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:54.536058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c7df7f80-66e9-4f1c-a74d-4c669df2d2fe tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:55.054969 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c7df7f80-66e9-4f1c-a74d-4c669df2d2fe tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:55.103971 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c7df7f80-66e9-4f1c-a74d-4c669df2d2fe tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1238 microversion: 2.1 time: 0.599148 Jun 21 15:53:55.104403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 19/33] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:54 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1238 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:55.129374 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b3badd9d-d5d8-48e0-b234-01cdb1df35c7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:55.140777 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b3badd9d-d5d8-48e0-b234-01cdb1df35c7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:55.397261 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:53:55.397997 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:53:55.399100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:53:55.399955 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:53:55.400900 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:53:55.463628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:55.466118 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:55.470569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:55.473671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:55.628392 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for project d20d29454c00499282eb86547eeb4c10. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:53:55.647138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for user 9a67a5c4b7034d22b78331b907cc20bc and project d20d29454c00499282eb86547eeb4c10. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:53:55.650380 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b3badd9d-d5d8-48e0-b234-01cdb1df35c7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:55.675163 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b3badd9d-d5d8-48e0-b234-01cdb1df35c7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1215 microversion: 2.1 time: 0.548685 Jun 21 15:53:55.681869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 20/34] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:55 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1215 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:55.688096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:53:55.690594 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:53:55.809067 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a5bf1827-d9ff-472b-a463-4d014bcaecf5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.362794 Jun 21 15:53:55.810444 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 15/35] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:53:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:53:55.825233 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6e31b08a-8cfa-4fee-929b-351ace394f86 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:55.826417 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6e31b08a-8cfa-4fee-929b-351ace394f86 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:56.017031 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6e31b08a-8cfa-4fee-929b-351ace394f86 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:56.039423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6e31b08a-8cfa-4fee-929b-351ace394f86 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1241 microversion: 2.1 time: 0.221839 Jun 21 15:53:56.040324 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 21/36] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:55 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1241 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:56.124762 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-68feb4b1-a224-4272-ab87-3d8a8fdc703d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:56.125542 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-68feb4b1-a224-4272-ab87-3d8a8fdc703d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:56.225053 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-68feb4b1-a224-4272-ab87-3d8a8fdc703d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:56.227338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-68feb4b1-a224-4272-ab87-3d8a8fdc703d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:56.230394 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-68feb4b1-a224-4272-ab87-3d8a8fdc703d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:56.231550 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-68feb4b1-a224-4272-ab87-3d8a8fdc703d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:56.480596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-805491058", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a2a2c79-171c-46ca-b6cc-a6b3bdd3c9a4"}], "security_groups": [{"name": "tempest-securitygroup--1524940021"}], "key_name": "tempest-keypair-1632838168", "user_data": "}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:53:56.638234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-68feb4b1-a224-4272-ab87-3d8a8fdc703d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:56.741934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-68feb4b1-a224-4272-ab87-3d8a8fdc703d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1242 microversion: 2.1 time: 0.618521 Jun 21 15:53:56.753834 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 16/37] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:56 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1242 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:56.778838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b63cca55-0e44-466e-9767-4034186db42b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:56.781214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b63cca55-0e44-466e-9767-4034186db42b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:56.812944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b63cca55-0e44-466e-9767-4034186db42b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:56.819356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b63cca55-0e44-466e-9767-4034186db42b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:56.826215 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b63cca55-0e44-466e-9767-4034186db42b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:56.828234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b63cca55-0e44-466e-9767-4034186db42b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:56.941853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] validate_networks() for [('7a2a2c79-171c-46ca-b6cc-a6b3bdd3c9a4', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:53:57.191083 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b63cca55-0e44-466e-9767-4034186db42b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:57.210298 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b63cca55-0e44-466e-9767-4034186db42b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1219 microversion: 2.1 time: 0.460216 Jun 21 15:53:57.226919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 17/38] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:56 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1219 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:57.235861 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3bc3f2ec-1fc2-4a5d-893d-68a7552a6282 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:57.236479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3bc3f2ec-1fc2-4a5d-893d-68a7552a6282 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:57.267897 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3bc3f2ec-1fc2-4a5d-893d-68a7552a6282 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:57.268360 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3bc3f2ec-1fc2-4a5d-893d-68a7552a6282 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:57.277894 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3bc3f2ec-1fc2-4a5d-893d-68a7552a6282 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:57.278414 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3bc3f2ec-1fc2-4a5d-893d-68a7552a6282 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:57.564310 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3bc3f2ec-1fc2-4a5d-893d-68a7552a6282 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:57.579186 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3bc3f2ec-1fc2-4a5d-893d-68a7552a6282 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1245 microversion: 2.1 time: 0.348822 Jun 21 15:53:57.582030 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 18/39] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:57 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1245 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:57.761595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-257d33a7-2f17-4d4d-b15d-64922cc849e0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:57.762243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-257d33a7-2f17-4d4d-b15d-64922cc849e0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:57.776998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-257d33a7-2f17-4d4d-b15d-64922cc849e0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:57.781082 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-257d33a7-2f17-4d4d-b15d-64922cc849e0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:57.787312 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-257d33a7-2f17-4d4d-b15d-64922cc849e0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:57.791177 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-257d33a7-2f17-4d4d-b15d-64922cc849e0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:58.091185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-257d33a7-2f17-4d4d-b15d-64922cc849e0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:58.105342 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-257d33a7-2f17-4d4d-b15d-64922cc849e0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1298 microversion: 2.1 time: 0.343093 Jun 21 15:53:58.126578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 19/40] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:57 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1298 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:58.232419 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-86863b77-859e-4375-ba92-90b641baf11f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:58.233133 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-86863b77-859e-4375-ba92-90b641baf11f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:58.252039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86863b77-859e-4375-ba92-90b641baf11f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:58.258733 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86863b77-859e-4375-ba92-90b641baf11f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:58.262037 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86863b77-859e-4375-ba92-90b641baf11f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:58.263954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86863b77-859e-4375-ba92-90b641baf11f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:58.805390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-86863b77-859e-4375-ba92-90b641baf11f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:58.814686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-86863b77-859e-4375-ba92-90b641baf11f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1275 microversion: 2.1 time: 0.591548 Jun 21 15:53:58.815283 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 20/41] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:58 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1275 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:53:58.851891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-adafddf7-d03b-4014-8b30-8106c3d01d0e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:58.852589 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-adafddf7-d03b-4014-8b30-8106c3d01d0e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:58.881356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-adafddf7-d03b-4014-8b30-8106c3d01d0e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:58.883297 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-adafddf7-d03b-4014-8b30-8106c3d01d0e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:58.887446 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-adafddf7-d03b-4014-8b30-8106c3d01d0e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:58.888572 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-adafddf7-d03b-4014-8b30-8106c3d01d0e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:59.137138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-adafddf7-d03b-4014-8b30-8106c3d01d0e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:59.150181 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-adafddf7-d03b-4014-8b30-8106c3d01d0e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1311 microversion: 2.1 time: 0.331261 Jun 21 15:53:59.150817 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 21/42] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:58 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:59.166232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3bcfa051-3fd2-46bd-b72d-e0c2692c11f8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:59.166855 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3bcfa051-3fd2-46bd-b72d-e0c2692c11f8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:59.183285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3bcfa051-3fd2-46bd-b72d-e0c2692c11f8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:59.187900 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3bcfa051-3fd2-46bd-b72d-e0c2692c11f8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:59.188817 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3bcfa051-3fd2-46bd-b72d-e0c2692c11f8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:59.190877 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3bcfa051-3fd2-46bd-b72d-e0c2692c11f8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:59.340486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3bcfa051-3fd2-46bd-b72d-e0c2692c11f8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:53:59.345482 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:53:59.346022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:53:59.346444 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:53:59.347007 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:53:59.347546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:53:59.370455 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3bcfa051-3fd2-46bd-b72d-e0c2692c11f8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1296 microversion: 2.1 time: 0.216087 Jun 21 15:53:59.374011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:59.374473 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:59.375262 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:59.375697 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:59.388909 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 22/43] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:59 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1296 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:53:59.437378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Getting quotas for project 74f3f5c4b63c45d691e2b66883eda54a. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:53:59.451404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Getting quotas for user 75407a21b1fd46e8ba10540fc5a4c30a and project 74f3f5c4b63c45d691e2b66883eda54a. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:53:59.521918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:53:59.531841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:53:59.746760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-11ffee31-d292-42e3-a42c-3fc29cc3f12d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.269519 Jun 21 15:53:59.751317 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 22/44] 10.222.0.52 () {62 vars in 1187 bytes} [Tue Jun 21 15:53:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3276 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 21 15:53:59.763098 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d0a6f9de-d2d8-41ef-bbac-dcef204b4d3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:59.763895 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d0a6f9de-d2d8-41ef-bbac-dcef204b4d3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:59.837260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bd6285e3-f37b-455f-acac-00bdfce05ff4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:53:59.838249 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bd6285e3-f37b-455f-acac-00bdfce05ff4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:53:59.899435 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bd6285e3-f37b-455f-acac-00bdfce05ff4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:59.899435 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bd6285e3-f37b-455f-acac-00bdfce05ff4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:53:59.899435 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bd6285e3-f37b-455f-acac-00bdfce05ff4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:53:59.909369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bd6285e3-f37b-455f-acac-00bdfce05ff4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:00.129907 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d0a6f9de-d2d8-41ef-bbac-dcef204b4d3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:00.212227 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d0a6f9de-d2d8-41ef-bbac-dcef204b4d3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:00.221853 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d0a6f9de-d2d8-41ef-bbac-dcef204b4d3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:00.226299 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d0a6f9de-d2d8-41ef-bbac-dcef204b4d3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1281 microversion: 2.20 time: 0.465380 Jun 21 15:54:00.230712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:53:59 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1281 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:00.267855 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-df3ccef4-9b44-4e11-8bd4-e446213fddc6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:00.269543 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-df3ccef4-9b44-4e11-8bd4-e446213fddc6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:00.297145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-df3ccef4-9b44-4e11-8bd4-e446213fddc6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:00.297916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-df3ccef4-9b44-4e11-8bd4-e446213fddc6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:00.299712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-df3ccef4-9b44-4e11-8bd4-e446213fddc6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:00.302674 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-df3ccef4-9b44-4e11-8bd4-e446213fddc6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:00.487670 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-df3ccef4-9b44-4e11-8bd4-e446213fddc6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:00.525601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-df3ccef4-9b44-4e11-8bd4-e446213fddc6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1299 microversion: 2.1 time: 0.289704 Jun 21 15:54:00.543272 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 24/46] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:00 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1299 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:00.564798 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1d5b38d5-bdb4-4004-b67d-e7e360e89207 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:00.568098 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1d5b38d5-bdb4-4004-b67d-e7e360e89207 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:00.603898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1d5b38d5-bdb4-4004-b67d-e7e360e89207 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:00.604118 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1d5b38d5-bdb4-4004-b67d-e7e360e89207 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:00.633747 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1d5b38d5-bdb4-4004-b67d-e7e360e89207 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:00.634481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1d5b38d5-bdb4-4004-b67d-e7e360e89207 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:00.721143 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-bd6285e3-f37b-455f-acac-00bdfce05ff4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:00.763604 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bd6285e3-f37b-455f-acac-00bdfce05ff4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1273 microversion: 2.1 time: 0.934672 Jun 21 15:54:00.767415 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 23/47] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:53:59 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1273 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:00.817038 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1d5b38d5-bdb4-4004-b67d-e7e360e89207 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:00.860302 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1d5b38d5-bdb4-4004-b67d-e7e360e89207 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1296 microversion: 2.1 time: 0.312377 Jun 21 15:54:00.860942 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 25/48] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:00 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1296 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:01.258908 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:01.260108 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:01.295571 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:01.296029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:01.296827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:01.307625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:01.547832 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5842511b-04a8-4fab-bff1-a8f08369bbb3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:01.548597 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5842511b-04a8-4fab-bff1-a8f08369bbb3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:01.561326 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5842511b-04a8-4fab-bff1-a8f08369bbb3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:01.561822 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5842511b-04a8-4fab-bff1-a8f08369bbb3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:01.562587 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5842511b-04a8-4fab-bff1-a8f08369bbb3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:01.563017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5842511b-04a8-4fab-bff1-a8f08369bbb3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:01.596548 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:01.618847 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:01.623924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:01.626274 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-78ac1b39-1882-4845-838e-4ac61ba955e5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1277 microversion: 2.20 time: 0.383688 Jun 21 15:54:01.628831 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:01 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1277 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:01.749964 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5842511b-04a8-4fab-bff1-a8f08369bbb3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:01.767503 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5842511b-04a8-4fab-bff1-a8f08369bbb3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1299 microversion: 2.1 time: 0.222881 Jun 21 15:54:01.768888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 26/50] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:01 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:01.797058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6f670df1-be97-4739-ad65-f8b265db1122 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:01.798297 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6f670df1-be97-4739-ad65-f8b265db1122 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:01.828268 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6f670df1-be97-4739-ad65-f8b265db1122 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:01.833032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6f670df1-be97-4739-ad65-f8b265db1122 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:01.834079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6f670df1-be97-4739-ad65-f8b265db1122 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:01.835588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6f670df1-be97-4739-ad65-f8b265db1122 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:01.878164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3cb07f0f-f41b-4818-a459-e6855efbf39d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:01.878856 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3cb07f0f-f41b-4818-a459-e6855efbf39d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:01.890372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3cb07f0f-f41b-4818-a459-e6855efbf39d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:01.890788 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3cb07f0f-f41b-4818-a459-e6855efbf39d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:01.898242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3cb07f0f-f41b-4818-a459-e6855efbf39d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:01.898695 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3cb07f0f-f41b-4818-a459-e6855efbf39d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:02.022196 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6f670df1-be97-4739-ad65-f8b265db1122 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:02.035892 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6f670df1-be97-4739-ad65-f8b265db1122 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1273 microversion: 2.1 time: 0.254293 Jun 21 15:54:02.039666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 25/51] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:01 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:02.119032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3cb07f0f-f41b-4818-a459-e6855efbf39d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:02.135004 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3cb07f0f-f41b-4818-a459-e6855efbf39d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1296 microversion: 2.1 time: 0.260986 Jun 21 15:54:02.135596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 27/52] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:01 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1296 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:02.647770 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:02.648404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:02.655590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:02.656334 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:02.657522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:02.658133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:02.792899 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8c563442-d28c-4dc0-b358-c68931e8cb79 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:02.796145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8c563442-d28c-4dc0-b358-c68931e8cb79 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:02.825573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c563442-d28c-4dc0-b358-c68931e8cb79 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:02.829126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c563442-d28c-4dc0-b358-c68931e8cb79 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:02.836529 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c563442-d28c-4dc0-b358-c68931e8cb79 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:02.839718 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c563442-d28c-4dc0-b358-c68931e8cb79 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:03.095498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:03.110063 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:03.112635 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:03.114173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-cb50c4af-7977-4e17-b3ea-42360faa9df6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1339 microversion: 2.20 time: 0.470742 Jun 21 15:54:03.117844 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 26/53] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:02 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1339 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:03.135060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9be6bbad-60fb-4aab-acf0-5b469b782f29 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:03.136084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9be6bbad-60fb-4aab-acf0-5b469b782f29 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:03.160042 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9be6bbad-60fb-4aab-acf0-5b469b782f29 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:03.161507 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9be6bbad-60fb-4aab-acf0-5b469b782f29 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:03.162739 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9be6bbad-60fb-4aab-acf0-5b469b782f29 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:03.163406 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9be6bbad-60fb-4aab-acf0-5b469b782f29 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:03.282654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8c563442-d28c-4dc0-b358-c68931e8cb79 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:03.310874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8c563442-d28c-4dc0-b358-c68931e8cb79 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1299 microversion: 2.1 time: 0.528299 Jun 21 15:54:03.314505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 28/54] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:02 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1299 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:03.320845 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ca9ab870-aad0-4e71-9461-9c1655722703 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:03.333012 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ca9ab870-aad0-4e71-9461-9c1655722703 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:03.351428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9be6bbad-60fb-4aab-acf0-5b469b782f29 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:03.368246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9be6bbad-60fb-4aab-acf0-5b469b782f29 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1273 microversion: 2.1 time: 0.242299 Jun 21 15:54:03.370901 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 27/55] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:03 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:03.406295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ca9ab870-aad0-4e71-9461-9c1655722703 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:03.406835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ca9ab870-aad0-4e71-9461-9c1655722703 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:03.409998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ca9ab870-aad0-4e71-9461-9c1655722703 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:03.411991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ca9ab870-aad0-4e71-9461-9c1655722703 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:04.158424 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:04.170246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:04.187025 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ca9ab870-aad0-4e71-9461-9c1655722703 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:04.204534 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:04.205327 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:04.208027 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:04.208763 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:04.210306 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ca9ab870-aad0-4e71-9461-9c1655722703 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.888143 Jun 21 15:54:04.212262 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 29/56] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:03 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:04.332553 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b16c119f-3de4-4127-8d8f-7345c669744c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:04.334454 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b16c119f-3de4-4127-8d8f-7345c669744c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:04.349669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b16c119f-3de4-4127-8d8f-7345c669744c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:04.350250 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b16c119f-3de4-4127-8d8f-7345c669744c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:04.354857 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b16c119f-3de4-4127-8d8f-7345c669744c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:04.359525 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b16c119f-3de4-4127-8d8f-7345c669744c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:04.800590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:04.812550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:04.814119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:04.815334 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a06dacf7-bc09-40cd-8b15-c921f004ba33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1339 microversion: 2.20 time: 0.681718 Jun 21 15:54:04.843815 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 28/57] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:04 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1339 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:04.851541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-46de4173-4a89-4b58-b6d3-0f8ff92fb53b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:04.863726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-46de4173-4a89-4b58-b6d3-0f8ff92fb53b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:04.882504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-46de4173-4a89-4b58-b6d3-0f8ff92fb53b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:04.882964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-46de4173-4a89-4b58-b6d3-0f8ff92fb53b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:04.891247 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-46de4173-4a89-4b58-b6d3-0f8ff92fb53b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:04.895798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-46de4173-4a89-4b58-b6d3-0f8ff92fb53b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:05.013289 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b16c119f-3de4-4127-8d8f-7345c669744c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:05.024773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b16c119f-3de4-4127-8d8f-7345c669744c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.697387 Jun 21 15:54:05.034512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 30/58] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:04 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:05.232819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2759a569-4705-42fc-bd66-bee63854dd45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:05.237146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2759a569-4705-42fc-bd66-bee63854dd45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:05.250125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2759a569-4705-42fc-bd66-bee63854dd45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:05.253086 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2759a569-4705-42fc-bd66-bee63854dd45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:05.254174 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2759a569-4705-42fc-bd66-bee63854dd45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:05.266397 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2759a569-4705-42fc-bd66-bee63854dd45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:05.418901 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-46de4173-4a89-4b58-b6d3-0f8ff92fb53b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:05.433591 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-46de4173-4a89-4b58-b6d3-0f8ff92fb53b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.585449 Jun 21 15:54:05.435149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 29/59] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:04 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:05.542509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=4 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:05.835375 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:05.836169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:05.848170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:05.850305 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:05.851398 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:05.852876 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:06.384327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2759a569-4705-42fc-bd66-bee63854dd45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:06.416474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2759a569-4705-42fc-bd66-bee63854dd45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 1.190777 Jun 21 15:54:06.423078 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 31/60] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:05 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:06.450373 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-bfdd5b19-e37e-4e7e-9bd0-0398f1833a3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:06.451125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-bfdd5b19-e37e-4e7e-9bd0-0398f1833a3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:06.472440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bfdd5b19-e37e-4e7e-9bd0-0398f1833a3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:06.473223 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bfdd5b19-e37e-4e7e-9bd0-0398f1833a3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:06.474791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bfdd5b19-e37e-4e7e-9bd0-0398f1833a3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:06.477117 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bfdd5b19-e37e-4e7e-9bd0-0398f1833a3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:06.715444 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:06.731828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:06.739744 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:06.743205 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-aa7b41a5-9957-482f-8afd-672d7897bf5b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.913715 Jun 21 15:54:06.745935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 30/61] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:05 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:06.755925 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2d13b93d-892c-49b0-8c41-92e6b0b9b047 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:06.758586 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2d13b93d-892c-49b0-8c41-92e6b0b9b047 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:06.785807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d13b93d-892c-49b0-8c41-92e6b0b9b047 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:06.787830 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d13b93d-892c-49b0-8c41-92e6b0b9b047 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:06.788835 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d13b93d-892c-49b0-8c41-92e6b0b9b047 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:06.791265 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d13b93d-892c-49b0-8c41-92e6b0b9b047 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:07.899986 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bfdd5b19-e37e-4e7e-9bd0-0398f1833a3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:07.905723 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:07.924635 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-bfdd5b19-e37e-4e7e-9bd0-0398f1833a3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 1.498308 Jun 21 15:54:07.925267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 32/62] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:06 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:07.942112 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d42fee04-70f9-4cba-990d-1971b0dbd3e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:07.942929 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d42fee04-70f9-4cba-990d-1971b0dbd3e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:07.973909 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2d13b93d-892c-49b0-8c41-92e6b0b9b047 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:07.977640 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d42fee04-70f9-4cba-990d-1971b0dbd3e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:07.982940 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d42fee04-70f9-4cba-990d-1971b0dbd3e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:07.984103 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d42fee04-70f9-4cba-990d-1971b0dbd3e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:07.984586 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2d13b93d-892c-49b0-8c41-92e6b0b9b047 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 1.236003 Jun 21 15:54:07.985426 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d42fee04-70f9-4cba-990d-1971b0dbd3e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:07.996970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 31/63] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:06 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:08.021385 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:08.024136 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:08.056403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:08.057926 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:08.058831 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:08.059266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:09.281149 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d42fee04-70f9-4cba-990d-1971b0dbd3e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:09.287157 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d42fee04-70f9-4cba-990d-1971b0dbd3e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 1.360392 Jun 21 15:54:09.291302 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 33/64] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:07 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:09.308712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:09.319800 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:09.323152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-344a4242-318b-45e2-9174-9eb7539cb7fc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:09.329218 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:09.331826 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d4e2687f-2082-415e-a006-233b0215ca16 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 1.334611 Jun 21 15:54:09.341429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-344a4242-318b-45e2-9174-9eb7539cb7fc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:09.343978 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:07 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:09.359311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:09.362145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-344a4242-318b-45e2-9174-9eb7539cb7fc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:09.362588 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-344a4242-318b-45e2-9174-9eb7539cb7fc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:09.363357 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-344a4242-318b-45e2-9174-9eb7539cb7fc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:09.363837 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-344a4242-318b-45e2-9174-9eb7539cb7fc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:09.364977 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-60f5515c-c0b7-40b9-93b0-a3a87aa6419a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:09.368180 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-60f5515c-c0b7-40b9-93b0-a3a87aa6419a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:09.393579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-60f5515c-c0b7-40b9-93b0-a3a87aa6419a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:09.400654 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-60f5515c-c0b7-40b9-93b0-a3a87aa6419a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:09.401486 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-60f5515c-c0b7-40b9-93b0-a3a87aa6419a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:09.401952 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-60f5515c-c0b7-40b9-93b0-a3a87aa6419a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:09.424429 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=4 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:09.500527 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=22 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:09.977050 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-344a4242-318b-45e2-9174-9eb7539cb7fc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:09.996119 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-344a4242-318b-45e2-9174-9eb7539cb7fc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.695939 Jun 21 15:54:10.002479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 34/66] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:09 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:10.056591 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-60f5515c-c0b7-40b9-93b0-a3a87aa6419a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:10.071235 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-60f5515c-c0b7-40b9-93b0-a3a87aa6419a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.724668 Jun 21 15:54:10.082410 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 33/67] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:09 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:10.309857 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-efdb2b71-5d9e-4663-a28d-72008040241b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:10.311341 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-efdb2b71-5d9e-4663-a28d-72008040241b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:10.324402 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=22 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:10.328443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-efdb2b71-5d9e-4663-a28d-72008040241b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:10.330443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-efdb2b71-5d9e-4663-a28d-72008040241b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:10.332037 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-efdb2b71-5d9e-4663-a28d-72008040241b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:10.333702 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-efdb2b71-5d9e-4663-a28d-72008040241b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:10.362683 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:10.363254 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:10.388015 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:10.388753 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:10.390699 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:10.393811 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:11.448364 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-efdb2b71-5d9e-4663-a28d-72008040241b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:11.463088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-efdb2b71-5d9e-4663-a28d-72008040241b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 1.158522 Jun 21 15:54:11.474442 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 35/68] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:10 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:11.612140 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:11.626589 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:11.628232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:11.637692 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-54ec31b3-b4fd-4fe3-9f40-80faa6d98515 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 1.277961 Jun 21 15:54:11.651379 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 34/69] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:10 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:11.660423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5e6d4c23-e05a-4ec9-b1a8-cf8df9aee231 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:11.661351 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5e6d4c23-e05a-4ec9-b1a8-cf8df9aee231 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:11.669088 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5e6d4c23-e05a-4ec9-b1a8-cf8df9aee231 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:11.670674 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5e6d4c23-e05a-4ec9-b1a8-cf8df9aee231 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:11.671856 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5e6d4c23-e05a-4ec9-b1a8-cf8df9aee231 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:11.672525 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5e6d4c23-e05a-4ec9-b1a8-cf8df9aee231 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:11.772255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-e48edebf-075b-4a1e-986e-d323d8c5755a req-3ab67665-42d0-427e-9327-e5627b94ae82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899aef0a-2cf7-47b2-9b08-0068bde58dae", "tag": "6288bac4-2f2c-42ad-9eca-74ece6209900"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:54:11.800689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-e48edebf-075b-4a1e-986e-d323d8c5755a req-3ab67665-42d0-427e-9327-e5627b94ae82 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:11.801743 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-e48edebf-075b-4a1e-986e-d323d8c5755a req-3ab67665-42d0-427e-9327-e5627b94ae82 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:11.859820 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-e48edebf-075b-4a1e-986e-d323d8c5755a req-3ab67665-42d0-427e-9327-e5627b94ae82 service nova] Creating event network-changed:6288bac4-2f2c-42ad-9eca-74ece6209900 for instance 899aef0a-2cf7-47b2-9b08-0068bde58dae on hv-cinder-84067 Jun 21 15:54:11.860667 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-e48edebf-075b-4a1e-986e-d323d8c5755a req-3ab67665-42d0-427e-9327-e5627b94ae82 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 15:54:11.862619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb94737a-35ea-4f10-be75-b0ab6722cd04 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:11.863336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb94737a-35ea-4f10-be75-b0ab6722cd04 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:11.871749 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb94737a-35ea-4f10-be75-b0ab6722cd04 None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:11.880686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb94737a-35ea-4f10-be75-b0ab6722cd04 None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:11.896953 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.compute.rpcapi [None req-cb94737a-35ea-4f10-be75-b0ab6722cd04 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 15:54:11.898055 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb94737a-35ea-4f10-be75-b0ab6722cd04 None None] Releasing lock "compute-rpcapi-router" {{(pid=123938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 15:54:11.968224 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cb94737a-35ea-4f10-be75-b0ab6722cd04 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490328 Jun 21 15:54:11.969182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 36/70] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:54:11.980730 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6dc9de04-60d5-498e-a31b-96f3b45cd39d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:11.982408 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6dc9de04-60d5-498e-a31b-96f3b45cd39d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:11.997310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5e6d4c23-e05a-4ec9-b1a8-cf8df9aee231 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:12.002114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6dc9de04-60d5-498e-a31b-96f3b45cd39d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.002588 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6dc9de04-60d5-498e-a31b-96f3b45cd39d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:12.005155 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6dc9de04-60d5-498e-a31b-96f3b45cd39d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.005637 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6dc9de04-60d5-498e-a31b-96f3b45cd39d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:12.019028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5e6d4c23-e05a-4ec9-b1a8-cf8df9aee231 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.366020 Jun 21 15:54:12.036870 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 35/71] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:11 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:12.497214 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-2b2484b1-752f-4014-8598-fd968ce48ffb req-f4f69e0d-6204-4f54-8a87-0d5f9b9a3ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec4529a-7353-4e5e-9445-92924998e57c", "tag": "d17f1129-12c2-4041-a70f-9aac14587914"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:54:12.529422 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-2b2484b1-752f-4014-8598-fd968ce48ffb req-f4f69e0d-6204-4f54-8a87-0d5f9b9a3ed7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.543673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-2b2484b1-752f-4014-8598-fd968ce48ffb req-f4f69e0d-6204-4f54-8a87-0d5f9b9a3ed7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:12.559322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6dc9de04-60d5-498e-a31b-96f3b45cd39d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:12.570684 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6dc9de04-60d5-498e-a31b-96f3b45cd39d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.599652 Jun 21 15:54:12.575917 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 37/72] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:11 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:12.593878 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a4db5ba8-ca07-459a-b3a6-5fe8d990812b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:12.596108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a4db5ba8-ca07-459a-b3a6-5fe8d990812b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:12.614302 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a4db5ba8-ca07-459a-b3a6-5fe8d990812b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.615344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a4db5ba8-ca07-459a-b3a6-5fe8d990812b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:12.615471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-2b2484b1-752f-4014-8598-fd968ce48ffb req-f4f69e0d-6204-4f54-8a87-0d5f9b9a3ed7 service nova] Creating event network-changed:d17f1129-12c2-4041-a70f-9aac14587914 for instance aec4529a-7353-4e5e-9445-92924998e57c on hv-cinder-84067 Jun 21 15:54:12.616868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a4db5ba8-ca07-459a-b3a6-5fe8d990812b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.617647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a4db5ba8-ca07-459a-b3a6-5fe8d990812b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:12.617886 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-2b2484b1-752f-4014-8598-fd968ce48ffb req-f4f69e0d-6204-4f54-8a87-0d5f9b9a3ed7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 15:54:12.619077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0be4061e-39d5-433d-aafa-864cf905c074 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.619519 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0be4061e-39d5-433d-aafa-864cf905c074 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:12.620306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0be4061e-39d5-433d-aafa-864cf905c074 None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.620731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0be4061e-39d5-433d-aafa-864cf905c074 None None] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:12.658068 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.compute.rpcapi [None req-0be4061e-39d5-433d-aafa-864cf905c074 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 15:54:12.659050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0be4061e-39d5-433d-aafa-864cf905c074 None None] Releasing lock "compute-rpcapi-router" {{(pid=123939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 15:54:12.717715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0be4061e-39d5-433d-aafa-864cf905c074 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.670068 Jun 21 15:54:12.718555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 36/73] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:54:12.730677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:12.735321 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:12.751214 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.753544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:12.755502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:12.756467 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:13.277666 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a4db5ba8-ca07-459a-b3a6-5fe8d990812b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:13.287005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a4db5ba8-ca07-459a-b3a6-5fe8d990812b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.709488 Jun 21 15:54:13.296734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 38/74] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:12 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:13.303855 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-81046f1e-d0be-4625-ae46-83b322a0edc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:13.304731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-81046f1e-d0be-4625-ae46-83b322a0edc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:13.313620 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81046f1e-d0be-4625-ae46-83b322a0edc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:13.315297 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81046f1e-d0be-4625-ae46-83b322a0edc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:13.317430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81046f1e-d0be-4625-ae46-83b322a0edc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:13.318314 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81046f1e-d0be-4625-ae46-83b322a0edc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:13.326869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:13.336234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:13.337745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:13.339142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1ac3392e-daa7-4eb9-94f7-bbc771002c27 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.618685 Jun 21 15:54:13.339699 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 37/75] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:12 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:13.466640 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-81046f1e-d0be-4625-ae46-83b322a0edc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:13.475604 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-81046f1e-d0be-4625-ae46-83b322a0edc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.177835 Jun 21 15:54:13.476174 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:13 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:13.593823 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d669257b-8916-41ae-9b32-019bfbc1bb60 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:13.594729 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d669257b-8916-41ae-9b32-019bfbc1bb60 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:13.601758 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d669257b-8916-41ae-9b32-019bfbc1bb60 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:13.602296 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d669257b-8916-41ae-9b32-019bfbc1bb60 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:13.603135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d669257b-8916-41ae-9b32-019bfbc1bb60 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:13.603784 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d669257b-8916-41ae-9b32-019bfbc1bb60 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:13.759863 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d669257b-8916-41ae-9b32-019bfbc1bb60 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:13.768845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d669257b-8916-41ae-9b32-019bfbc1bb60 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.179406 Jun 21 15:54:13.770165 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 38/77] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:13 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:14.304228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c69c460f-f598-4bfd-85b7-8564435216c3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:14.304856 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c69c460f-f598-4bfd-85b7-8564435216c3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:14.311568 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c69c460f-f598-4bfd-85b7-8564435216c3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.312066 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c69c460f-f598-4bfd-85b7-8564435216c3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.312857 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c69c460f-f598-4bfd-85b7-8564435216c3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.313430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c69c460f-f598-4bfd-85b7-8564435216c3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.356270 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:14.356865 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:14.364511 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.364982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.365743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.366183 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.370506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:14.507116 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c69c460f-f598-4bfd-85b7-8564435216c3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:14.515602 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c69c460f-f598-4bfd-85b7-8564435216c3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.215534 Jun 21 15:54:14.516211 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 40/78] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:14 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:14.521968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-20ed1b5d-292f-4ab2-9070-f358204b0e7c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:14.522568 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-20ed1b5d-292f-4ab2-9070-f358204b0e7c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:14.529014 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20ed1b5d-292f-4ab2-9070-f358204b0e7c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.529459 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20ed1b5d-292f-4ab2-9070-f358204b0e7c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.530241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20ed1b5d-292f-4ab2-9070-f358204b0e7c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.530655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20ed1b5d-292f-4ab2-9070-f358204b0e7c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.597341 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:14.606394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:14.608276 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:14.609452 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-188cb57a-b08f-4d11-bb15-1a9a2d80947e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.256987 Jun 21 15:54:14.620770 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 39/79] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:14 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:14.699428 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-20ed1b5d-292f-4ab2-9070-f358204b0e7c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:14.707111 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-20ed1b5d-292f-4ab2-9070-f358204b0e7c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.188810 Jun 21 15:54:14.719988 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 41/80] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:14 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:14.787237 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-718614e8-7145-4a56-a432-ab9e48f01c06 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:14.788663 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-718614e8-7145-4a56-a432-ab9e48f01c06 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:14.795381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-718614e8-7145-4a56-a432-ab9e48f01c06 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.795907 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-718614e8-7145-4a56-a432-ab9e48f01c06 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.796729 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-718614e8-7145-4a56-a432-ab9e48f01c06 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.797233 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-718614e8-7145-4a56-a432-ab9e48f01c06 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.835577 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-c1f7ac55-0f5b-4932-b5d9-b650f3a8309c req-2282a7fc-977a-41b9-a158-0483ba23bbfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd1f66a-f226-49c0-8f07-54b3c9abc2c2", "tag": "e91ce2c0-3142-4f10-9149-df9295df6dc5"}, {"name": "network-changed", "server_uuid": "c6f494bc-2b5c-48f9-9842-5982a0d81192", "tag": "c891b3c8-5701-448e-86d1-f82bb6aa0a97"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:54:14.849596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-c1f7ac55-0f5b-4932-b5d9-b650f3a8309c req-2282a7fc-977a-41b9-a158-0483ba23bbfe service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:14.850122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-c1f7ac55-0f5b-4932-b5d9-b650f3a8309c req-2282a7fc-977a-41b9-a158-0483ba23bbfe service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:14.883475 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-c1f7ac55-0f5b-4932-b5d9-b650f3a8309c req-2282a7fc-977a-41b9-a158-0483ba23bbfe service nova] Creating event network-changed:e91ce2c0-3142-4f10-9149-df9295df6dc5 for instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 on hv-cinder-84067 Jun 21 15:54:14.883975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-c1f7ac55-0f5b-4932-b5d9-b650f3a8309c req-2282a7fc-977a-41b9-a158-0483ba23bbfe service nova] Creating event network-changed:c891b3c8-5701-448e-86d1-f82bb6aa0a97 for instance c6f494bc-2b5c-48f9-9842-5982a0d81192 on hv-cinder-84067 Jun 21 15:54:14.891891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-c1f7ac55-0f5b-4932-b5d9-b650f3a8309c req-2282a7fc-977a-41b9-a158-0483ba23bbfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063696 Jun 21 15:54:14.893097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 42/81] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:54:14.960510 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-718614e8-7145-4a56-a432-ab9e48f01c06 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:14.971029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-718614e8-7145-4a56-a432-ab9e48f01c06 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.189152 Jun 21 15:54:14.972420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 40/82] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:14 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:15.534448 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c6b0b1e8-1172-430d-9fcd-3b7c21d7a543 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:15.535705 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c6b0b1e8-1172-430d-9fcd-3b7c21d7a543 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:15.543136 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c6b0b1e8-1172-430d-9fcd-3b7c21d7a543 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:15.543850 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c6b0b1e8-1172-430d-9fcd-3b7c21d7a543 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:15.544612 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c6b0b1e8-1172-430d-9fcd-3b7c21d7a543 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:15.545074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c6b0b1e8-1172-430d-9fcd-3b7c21d7a543 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:15.628470 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:15.629472 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:15.635802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:15.636266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:15.637192 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:15.637877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:15.798319 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c6b0b1e8-1172-430d-9fcd-3b7c21d7a543 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:15.806315 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c6b0b1e8-1172-430d-9fcd-3b7c21d7a543 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.276608 Jun 21 15:54:15.815802 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 43/83] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:15 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:15.822327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-20892ee6-d41a-4299-9ec6-c70992698f8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:15.823011 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-20892ee6-d41a-4299-9ec6-c70992698f8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:15.831003 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20892ee6-d41a-4299-9ec6-c70992698f8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:15.831429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20892ee6-d41a-4299-9ec6-c70992698f8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:15.832478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20892ee6-d41a-4299-9ec6-c70992698f8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:15.832904 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20892ee6-d41a-4299-9ec6-c70992698f8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:15.867477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:15.878843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:15.886647 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:15.887795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a844264a-34ed-4a44-8cb9-436a6c87e487 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.263969 Jun 21 15:54:15.888346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 41/84] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:15 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:15.989434 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-72019ac8-5110-4134-88bf-7462292f55e2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:15.991783 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-72019ac8-5110-4134-88bf-7462292f55e2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:15.998823 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-72019ac8-5110-4134-88bf-7462292f55e2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:15.999474 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-72019ac8-5110-4134-88bf-7462292f55e2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:16.000625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-72019ac8-5110-4134-88bf-7462292f55e2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:16.001258 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-72019ac8-5110-4134-88bf-7462292f55e2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:16.011417 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-20892ee6-d41a-4299-9ec6-c70992698f8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:16.021530 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-20892ee6-d41a-4299-9ec6-c70992698f8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.213247 Jun 21 15:54:16.022838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 44/85] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:15 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:16.160743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-72019ac8-5110-4134-88bf-7462292f55e2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:16.168721 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-72019ac8-5110-4134-88bf-7462292f55e2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.184010 Jun 21 15:54:16.169295 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 42/86] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:15 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:16.823463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0b719809-e037-460c-b4b9-a6f17ab3f903 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:16.824292 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0b719809-e037-460c-b4b9-a6f17ab3f903 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:16.830389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0b719809-e037-460c-b4b9-a6f17ab3f903 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:16.830906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0b719809-e037-460c-b4b9-a6f17ab3f903 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:16.831915 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0b719809-e037-460c-b4b9-a6f17ab3f903 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:16.832429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0b719809-e037-460c-b4b9-a6f17ab3f903 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:16.914257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:16.915163 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:16.918306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:16.923272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:16.923715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:16.924779 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:16.925346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:17.005485 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0b719809-e037-460c-b4b9-a6f17ab3f903 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:17.014685 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0b719809-e037-460c-b4b9-a6f17ab3f903 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.195030 Jun 21 15:54:17.015833 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 45/87] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:16 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:17.041031 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-63825d9b-767d-4b8c-abcb-54e8ffac1d6d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:17.041755 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-63825d9b-767d-4b8c-abcb-54e8ffac1d6d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:17.052122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-63825d9b-767d-4b8c-abcb-54e8ffac1d6d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:17.052555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-63825d9b-767d-4b8c-abcb-54e8ffac1d6d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:17.053385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-63825d9b-767d-4b8c-abcb-54e8ffac1d6d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:17.053898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-63825d9b-767d-4b8c-abcb-54e8ffac1d6d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:17.107061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:17.116516 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:17.118059 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:17.119389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-43233afd-4d19-455b-b37e-ffb370be20b4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.212970 Jun 21 15:54:17.120015 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 43/88] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:16 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:17.188235 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-73d3bd2a-2a2f-4900-9d49-76d6b362417c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:17.188833 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-73d3bd2a-2a2f-4900-9d49-76d6b362417c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:17.196134 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-73d3bd2a-2a2f-4900-9d49-76d6b362417c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:17.196838 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-73d3bd2a-2a2f-4900-9d49-76d6b362417c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:17.197660 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-73d3bd2a-2a2f-4900-9d49-76d6b362417c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:17.201192 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-73d3bd2a-2a2f-4900-9d49-76d6b362417c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:17.222829 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-63825d9b-767d-4b8c-abcb-54e8ffac1d6d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:17.230744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-63825d9b-767d-4b8c-abcb-54e8ffac1d6d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.195137 Jun 21 15:54:17.231314 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 46/89] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:17 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:17.344867 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-73d3bd2a-2a2f-4900-9d49-76d6b362417c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:17.353871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-73d3bd2a-2a2f-4900-9d49-76d6b362417c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.170909 Jun 21 15:54:17.354580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 44/90] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:17 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:18.037244 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ee47a0c2-0876-4d33-a762-b48d6f4689e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:18.039300 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ee47a0c2-0876-4d33-a762-b48d6f4689e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:18.050401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ee47a0c2-0876-4d33-a762-b48d6f4689e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:18.051657 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ee47a0c2-0876-4d33-a762-b48d6f4689e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:18.052936 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ee47a0c2-0876-4d33-a762-b48d6f4689e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:18.053862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ee47a0c2-0876-4d33-a762-b48d6f4689e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:18.138067 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:18.139511 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:18.153042 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:18.153832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:18.155566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:18.162159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:18.346832 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ee47a0c2-0876-4d33-a762-b48d6f4689e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:18.356052 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ee47a0c2-0876-4d33-a762-b48d6f4689e8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.327058 Jun 21 15:54:18.357286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 47/91] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:18 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:18.381751 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-93a4032a-762d-4b0b-b694-658079ff747e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:18.382679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-93a4032a-762d-4b0b-b694-658079ff747e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:18.400994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-93a4032a-762d-4b0b-b694-658079ff747e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:18.401787 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-93a4032a-762d-4b0b-b694-658079ff747e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:18.405228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-93a4032a-762d-4b0b-b694-658079ff747e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:18.405975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-93a4032a-762d-4b0b-b694-658079ff747e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:18.449616 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:18.475940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:18.477545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:18.478736 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e5d08018-29cf-430e-b435-e2c2c7b4f67c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.344666 Jun 21 15:54:18.479277 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 45/92] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:18 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:18.484132 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ac004e4e-d101-40a5-a8e7-7f65161563cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:18.484730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ac004e4e-d101-40a5-a8e7-7f65161563cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:18.496696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ac004e4e-d101-40a5-a8e7-7f65161563cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:18.497284 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ac004e4e-d101-40a5-a8e7-7f65161563cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:18.498176 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ac004e4e-d101-40a5-a8e7-7f65161563cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:18.498828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ac004e4e-d101-40a5-a8e7-7f65161563cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:18.648882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-93a4032a-762d-4b0b-b694-658079ff747e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:18.666942 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-93a4032a-762d-4b0b-b694-658079ff747e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.294397 Jun 21 15:54:18.667539 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 48/93] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:18 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:18.737273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ac004e4e-d101-40a5-a8e7-7f65161563cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:18.751144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ac004e4e-d101-40a5-a8e7-7f65161563cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.270823 Jun 21 15:54:18.752089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 46/94] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:18 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:19.380711 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6a2f222d-a531-4516-93fe-b1afa00ac006 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:19.380711 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6a2f222d-a531-4516-93fe-b1afa00ac006 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:19.386779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6a2f222d-a531-4516-93fe-b1afa00ac006 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:19.387578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6a2f222d-a531-4516-93fe-b1afa00ac006 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:19.388406 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6a2f222d-a531-4516-93fe-b1afa00ac006 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:19.388867 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6a2f222d-a531-4516-93fe-b1afa00ac006 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:19.497209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:19.497843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:19.504950 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:19.505387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:19.506184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:19.506607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:19.541221 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6a2f222d-a531-4516-93fe-b1afa00ac006 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:19.548949 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6a2f222d-a531-4516-93fe-b1afa00ac006 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.174078 Jun 21 15:54:19.549519 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 49/95] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:19 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:19.679313 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:19.686890 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-addb9e9e-402b-401a-88fe-d6467820d99c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:19.687331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:19.687478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-addb9e9e-402b-401a-88fe-d6467820d99c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:19.688839 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:19.690207 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5b4a6179-a9cc-4224-b071-9ae8da5af246 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.197506 Jun 21 15:54:19.691327 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 47/96] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:19 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:19.701321 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-addb9e9e-402b-401a-88fe-d6467820d99c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:19.701321 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-addb9e9e-402b-401a-88fe-d6467820d99c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:19.701321 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-addb9e9e-402b-401a-88fe-d6467820d99c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:19.701321 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-addb9e9e-402b-401a-88fe-d6467820d99c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:19.723857 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:19.770670 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b9f84274-e7ba-49f0-a07a-fa2ff266cf26 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:19.771284 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b9f84274-e7ba-49f0-a07a-fa2ff266cf26 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:19.777951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b9f84274-e7ba-49f0-a07a-fa2ff266cf26 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:19.778662 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b9f84274-e7ba-49f0-a07a-fa2ff266cf26 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:19.779742 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b9f84274-e7ba-49f0-a07a-fa2ff266cf26 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:19.780168 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b9f84274-e7ba-49f0-a07a-fa2ff266cf26 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:19.893495 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-addb9e9e-402b-401a-88fe-d6467820d99c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:19.902386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-addb9e9e-402b-401a-88fe-d6467820d99c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.221871 Jun 21 15:54:19.912595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 50/97] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:19 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:19.941900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b9f84274-e7ba-49f0-a07a-fa2ff266cf26 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:19.949589 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b9f84274-e7ba-49f0-a07a-fa2ff266cf26 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.183235 Jun 21 15:54:19.950172 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 48/98] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:19 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:20.566714 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2b2a6402-7950-4ec8-97b1-ea9c7537e474 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:20.567315 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2b2a6402-7950-4ec8-97b1-ea9c7537e474 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:20.573479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b2a6402-7950-4ec8-97b1-ea9c7537e474 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:20.573959 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b2a6402-7950-4ec8-97b1-ea9c7537e474 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:20.574802 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b2a6402-7950-4ec8-97b1-ea9c7537e474 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:20.575287 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b2a6402-7950-4ec8-97b1-ea9c7537e474 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:20.711036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:20.711727 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2b2a6402-7950-4ec8-97b1-ea9c7537e474 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:20.713022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:20.719714 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2b2a6402-7950-4ec8-97b1-ea9c7537e474 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.157620 Jun 21 15:54:20.720623 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 51/99] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:20 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:20.722931 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:20.723572 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:20.724764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:20.725331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:20.895966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:20.904270 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:20.905798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:20.906954 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-09526002-bc8c-4cc0-96a0-d6d65c31621b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.202368 Jun 21 15:54:20.907512 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 49/100] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:20 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:20.923455 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dccd7737-e9f7-4a6f-ad9a-3c8a87a533ee tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:20.924074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dccd7737-e9f7-4a6f-ad9a-3c8a87a533ee tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:20.930624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dccd7737-e9f7-4a6f-ad9a-3c8a87a533ee tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:20.931071 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dccd7737-e9f7-4a6f-ad9a-3c8a87a533ee tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:20.931862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dccd7737-e9f7-4a6f-ad9a-3c8a87a533ee tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:20.932291 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dccd7737-e9f7-4a6f-ad9a-3c8a87a533ee tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:20.966849 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f8dcb0c9-4dd1-40b0-8710-8e2c5d67891b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:20.968755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f8dcb0c9-4dd1-40b0-8710-8e2c5d67891b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:20.976306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f8dcb0c9-4dd1-40b0-8710-8e2c5d67891b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:20.977106 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f8dcb0c9-4dd1-40b0-8710-8e2c5d67891b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:20.977863 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f8dcb0c9-4dd1-40b0-8710-8e2c5d67891b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:20.979111 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f8dcb0c9-4dd1-40b0-8710-8e2c5d67891b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:21.143544 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dccd7737-e9f7-4a6f-ad9a-3c8a87a533ee tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:21.152751 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dccd7737-e9f7-4a6f-ad9a-3c8a87a533ee tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.233758 Jun 21 15:54:21.153436 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 52/101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:20 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:21.178416 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f8dcb0c9-4dd1-40b0-8710-8e2c5d67891b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:21.192514 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f8dcb0c9-4dd1-40b0-8710-8e2c5d67891b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.229861 Jun 21 15:54:21.193098 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 50/102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:20 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:21.739181 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b00cd3df-e814-4e98-bae7-39a37993f8c6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:21.740422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b00cd3df-e814-4e98-bae7-39a37993f8c6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:21.746975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b00cd3df-e814-4e98-bae7-39a37993f8c6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:21.747467 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b00cd3df-e814-4e98-bae7-39a37993f8c6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:21.748323 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b00cd3df-e814-4e98-bae7-39a37993f8c6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:21.748825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b00cd3df-e814-4e98-bae7-39a37993f8c6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:21.895117 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:21.918017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b00cd3df-e814-4e98-bae7-39a37993f8c6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:21.924491 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:21.925090 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:21.934327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b00cd3df-e814-4e98-bae7-39a37993f8c6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.200191 Jun 21 15:54:21.934611 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:21.934963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 53/103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:21 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:21.935099 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:21.935820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:21.936441 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:22.081376 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:22.090228 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:22.091709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:22.092817 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a616424b-1a57-4035-ba2b-02125df71e52 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.172266 Jun 21 15:54:22.093375 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 51/104] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:21 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:22.169912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-619ce4dd-fdba-44d1-9259-023bf7549946 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:22.170518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-619ce4dd-fdba-44d1-9259-023bf7549946 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:22.177104 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-619ce4dd-fdba-44d1-9259-023bf7549946 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:22.177556 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-619ce4dd-fdba-44d1-9259-023bf7549946 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:22.178347 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-619ce4dd-fdba-44d1-9259-023bf7549946 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:22.178766 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-619ce4dd-fdba-44d1-9259-023bf7549946 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:22.208867 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a31e0f14-bf26-49a3-8128-47ea2b0231f3 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:22.209475 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a31e0f14-bf26-49a3-8128-47ea2b0231f3 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:22.216279 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a31e0f14-bf26-49a3-8128-47ea2b0231f3 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:22.216723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a31e0f14-bf26-49a3-8128-47ea2b0231f3 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:22.217490 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a31e0f14-bf26-49a3-8128-47ea2b0231f3 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:22.217950 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a31e0f14-bf26-49a3-8128-47ea2b0231f3 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:22.360793 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-619ce4dd-fdba-44d1-9259-023bf7549946 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:22.369824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-619ce4dd-fdba-44d1-9259-023bf7549946 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.203453 Jun 21 15:54:22.370401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 54/105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:22 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:22.387357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a31e0f14-bf26-49a3-8128-47ea2b0231f3 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:22.395465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a31e0f14-bf26-49a3-8128-47ea2b0231f3 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.190554 Jun 21 15:54:22.396001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 52/106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:22 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:22.952028 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0db698ff-fad8-4d12-896e-055c5139d3aa tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:22.952618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0db698ff-fad8-4d12-896e-055c5139d3aa tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:22.959449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0db698ff-fad8-4d12-896e-055c5139d3aa tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:22.959864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0db698ff-fad8-4d12-896e-055c5139d3aa tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:22.960833 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0db698ff-fad8-4d12-896e-055c5139d3aa tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:22.961227 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0db698ff-fad8-4d12-896e-055c5139d3aa tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:23.101121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0db698ff-fad8-4d12-896e-055c5139d3aa tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:23.109634 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0db698ff-fad8-4d12-896e-055c5139d3aa tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.161760 Jun 21 15:54:23.110212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 55/107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:22 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:23.111719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:23.112338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:23.114290 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:23.120335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:23.120872 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:23.122146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:23.122822 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:23.267625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:23.276564 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:23.278072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:23.279173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-90a487af-0dee-456d-b5e5-440ee14995ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.171703 Jun 21 15:54:23.279722 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 53/108] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:23 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:23.388623 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-163141f5-3985-48ab-8365-ce21cb04a2ef tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:23.389195 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-163141f5-3985-48ab-8365-ce21cb04a2ef tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:23.397108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-163141f5-3985-48ab-8365-ce21cb04a2ef tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:23.397637 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-163141f5-3985-48ab-8365-ce21cb04a2ef tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:23.398504 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-163141f5-3985-48ab-8365-ce21cb04a2ef tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:23.398992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-163141f5-3985-48ab-8365-ce21cb04a2ef tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:23.413259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9ddfa8f6-7661-4bca-b6cd-0b98f2d4cdab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:23.413891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9ddfa8f6-7661-4bca-b6cd-0b98f2d4cdab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:23.420307 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ddfa8f6-7661-4bca-b6cd-0b98f2d4cdab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:23.420748 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ddfa8f6-7661-4bca-b6cd-0b98f2d4cdab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:23.421528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ddfa8f6-7661-4bca-b6cd-0b98f2d4cdab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:23.421989 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ddfa8f6-7661-4bca-b6cd-0b98f2d4cdab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:23.619182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-163141f5-3985-48ab-8365-ce21cb04a2ef tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:23.626863 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-163141f5-3985-48ab-8365-ce21cb04a2ef tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.242668 Jun 21 15:54:23.627440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 56/109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:23 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:23.636476 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9ddfa8f6-7661-4bca-b6cd-0b98f2d4cdab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:23.644990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9ddfa8f6-7661-4bca-b6cd-0b98f2d4cdab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.236026 Jun 21 15:54:23.645487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 54/110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:23 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:24.126898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-56997f46-0942-4c0e-8bf0-6c03fb0542cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:24.127486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-56997f46-0942-4c0e-8bf0-6c03fb0542cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:24.135138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-56997f46-0942-4c0e-8bf0-6c03fb0542cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:24.135587 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-56997f46-0942-4c0e-8bf0-6c03fb0542cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:24.136360 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-56997f46-0942-4c0e-8bf0-6c03fb0542cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:24.136788 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-56997f46-0942-4c0e-8bf0-6c03fb0542cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:24.285523 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-56997f46-0942-4c0e-8bf0-6c03fb0542cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:24.293592 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-56997f46-0942-4c0e-8bf0-6c03fb0542cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.170487 Jun 21 15:54:24.294335 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 57/111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:24 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:24.296634 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:24.297280 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:24.304885 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:24.305324 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:24.306120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:24.306549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:24.451212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:24.455910 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:24.462553 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:24.464022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:24.465350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dcd7cf09-a207-4a62-8753-050d0b74a1be tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.172395 Jun 21 15:54:24.465935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 55/112] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:24 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:24.646619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b9ba62e7-3305-4735-9692-85054c0ed39e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:24.647353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b9ba62e7-3305-4735-9692-85054c0ed39e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:24.656073 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b9ba62e7-3305-4735-9692-85054c0ed39e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:24.656713 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b9ba62e7-3305-4735-9692-85054c0ed39e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:24.657859 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b9ba62e7-3305-4735-9692-85054c0ed39e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:24.658426 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b9ba62e7-3305-4735-9692-85054c0ed39e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:24.662833 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a7bf7e31-6d76-48c6-8485-8d1ffcb6edfa tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:24.663435 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a7bf7e31-6d76-48c6-8485-8d1ffcb6edfa tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:24.669721 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a7bf7e31-6d76-48c6-8485-8d1ffcb6edfa tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:24.670196 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a7bf7e31-6d76-48c6-8485-8d1ffcb6edfa tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:24.670950 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a7bf7e31-6d76-48c6-8485-8d1ffcb6edfa tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:24.671376 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a7bf7e31-6d76-48c6-8485-8d1ffcb6edfa tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:24.861425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b9ba62e7-3305-4735-9692-85054c0ed39e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:24.865661 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a7bf7e31-6d76-48c6-8485-8d1ffcb6edfa tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:24.869951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b9ba62e7-3305-4735-9692-85054c0ed39e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.228779 Jun 21 15:54:24.870502 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 58/113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:24 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:24.873830 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a7bf7e31-6d76-48c6-8485-8d1ffcb6edfa tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.216026 Jun 21 15:54:24.874540 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 56/114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:24 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:25.310634 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-98fa4c88-caea-4c98-a4ff-2ec52d2b2aff tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:25.311404 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-98fa4c88-caea-4c98-a4ff-2ec52d2b2aff tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:25.318067 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98fa4c88-caea-4c98-a4ff-2ec52d2b2aff tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:25.318524 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98fa4c88-caea-4c98-a4ff-2ec52d2b2aff tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:25.319309 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98fa4c88-caea-4c98-a4ff-2ec52d2b2aff tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:25.319781 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98fa4c88-caea-4c98-a4ff-2ec52d2b2aff tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:25.464444 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-98fa4c88-caea-4c98-a4ff-2ec52d2b2aff tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:25.472615 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-98fa4c88-caea-4c98-a4ff-2ec52d2b2aff tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.165819 Jun 21 15:54:25.473186 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 59/115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:25 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:25.483868 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:25.484445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:25.492010 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:25.492378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:25.493126 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:25.493549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:25.633362 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:25.641548 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:25.643168 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:25.644388 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-eb60ea2e-d996-4a5c-833a-0132b7baa041 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.164768 Jun 21 15:54:25.644961 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 57/116] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:25 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:25.888554 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1e773a9a-e429-4251-b28d-7d686dce1c5d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:25.889162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1e773a9a-e429-4251-b28d-7d686dce1c5d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:25.891264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e2dce580-b8aa-449d-ae01-969b89aabf8f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:25.891918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e2dce580-b8aa-449d-ae01-969b89aabf8f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:25.897870 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e773a9a-e429-4251-b28d-7d686dce1c5d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:25.898308 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e773a9a-e429-4251-b28d-7d686dce1c5d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:25.899067 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2dce580-b8aa-449d-ae01-969b89aabf8f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:25.899180 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e773a9a-e429-4251-b28d-7d686dce1c5d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:25.899512 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2dce580-b8aa-449d-ae01-969b89aabf8f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:25.899619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e773a9a-e429-4251-b28d-7d686dce1c5d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:25.900269 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2dce580-b8aa-449d-ae01-969b89aabf8f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:25.900693 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2dce580-b8aa-449d-ae01-969b89aabf8f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:26.105347 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1e773a9a-e429-4251-b28d-7d686dce1c5d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:26.105720 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e2dce580-b8aa-449d-ae01-969b89aabf8f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:26.114317 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e2dce580-b8aa-449d-ae01-969b89aabf8f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.226702 Jun 21 15:54:26.121836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 58/117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:25 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:26.121972 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1e773a9a-e429-4251-b28d-7d686dce1c5d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.230873 Jun 21 15:54:26.121972 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 60/118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:25 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:26.490039 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e2449c67-b78f-4006-b98a-cd33e8a4649d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:26.491398 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e2449c67-b78f-4006-b98a-cd33e8a4649d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:26.503909 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2449c67-b78f-4006-b98a-cd33e8a4649d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:26.504550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2449c67-b78f-4006-b98a-cd33e8a4649d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:26.505310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2449c67-b78f-4006-b98a-cd33e8a4649d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:26.505741 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2449c67-b78f-4006-b98a-cd33e8a4649d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:26.663222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:26.664167 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:26.667326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e2449c67-b78f-4006-b98a-cd33e8a4649d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:26.673206 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:26.673908 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:26.675125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:26.675835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:26.676481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e2449c67-b78f-4006-b98a-cd33e8a4649d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.190802 Jun 21 15:54:26.677075 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 59/119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:26 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:26.827788 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:26.836449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:26.837984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:26.839233 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-35773e8c-2c23-4fa5-b725-905e9f4e8c75 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.180284 Jun 21 15:54:26.839809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 61/120] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:26 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:27.132805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5b0069ef-07c6-4250-a011-21ade8e95785 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:27.132993 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7dd68937-2e76-410a-9c41-115b1893c4bf tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:27.133464 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5b0069ef-07c6-4250-a011-21ade8e95785 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:27.133803 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7dd68937-2e76-410a-9c41-115b1893c4bf tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:27.141386 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7dd68937-2e76-410a-9c41-115b1893c4bf tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:27.141987 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7dd68937-2e76-410a-9c41-115b1893c4bf tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:27.142931 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5b0069ef-07c6-4250-a011-21ade8e95785 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:27.143052 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7dd68937-2e76-410a-9c41-115b1893c4bf tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:27.143595 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7dd68937-2e76-410a-9c41-115b1893c4bf tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:27.143965 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5b0069ef-07c6-4250-a011-21ade8e95785 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:27.145178 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5b0069ef-07c6-4250-a011-21ade8e95785 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:27.145926 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5b0069ef-07c6-4250-a011-21ade8e95785 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:27.402911 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5b0069ef-07c6-4250-a011-21ade8e95785 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:27.409686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7dd68937-2e76-410a-9c41-115b1893c4bf tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:27.412228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5b0069ef-07c6-4250-a011-21ade8e95785 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.283403 Jun 21 15:54:27.413295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 62/121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:27 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:27.430575 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7dd68937-2e76-410a-9c41-115b1893c4bf tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.302870 Jun 21 15:54:27.440933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 60/122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:27 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:27.694253 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e3eb8e00-8ebb-4f3e-83d7-0abcca220a10 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:27.694814 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e3eb8e00-8ebb-4f3e-83d7-0abcca220a10 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:27.706697 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e3eb8e00-8ebb-4f3e-83d7-0abcca220a10 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:27.707468 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e3eb8e00-8ebb-4f3e-83d7-0abcca220a10 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:27.708436 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e3eb8e00-8ebb-4f3e-83d7-0abcca220a10 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:27.708866 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e3eb8e00-8ebb-4f3e-83d7-0abcca220a10 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:27.859765 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:27.860391 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:27.870779 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:27.871371 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:27.872600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:27.873177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:27.914141 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e3eb8e00-8ebb-4f3e-83d7-0abcca220a10 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:27.927992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e3eb8e00-8ebb-4f3e-83d7-0abcca220a10 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.236083 Jun 21 15:54:27.930050 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 63/123] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:27 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:28.067075 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:28.077120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:28.078688 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:28.080019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d9406df0-83fe-47cc-96d3-fc7e92d9e30d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.224864 Jun 21 15:54:28.080792 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 61/124] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:27 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:28.430512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c950ffff-cc92-4449-a83c-0b89ca051e56 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:28.431251 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c950ffff-cc92-4449-a83c-0b89ca051e56 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:28.437893 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c950ffff-cc92-4449-a83c-0b89ca051e56 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:28.438700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c950ffff-cc92-4449-a83c-0b89ca051e56 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:28.439741 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c950ffff-cc92-4449-a83c-0b89ca051e56 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:28.440269 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c950ffff-cc92-4449-a83c-0b89ca051e56 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:28.451122 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d611e1e1-12e4-469a-a5d1-663777e60d2a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:28.451884 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d611e1e1-12e4-469a-a5d1-663777e60d2a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:28.461687 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d611e1e1-12e4-469a-a5d1-663777e60d2a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:28.462302 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d611e1e1-12e4-469a-a5d1-663777e60d2a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:28.466558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d611e1e1-12e4-469a-a5d1-663777e60d2a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:28.466991 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d611e1e1-12e4-469a-a5d1-663777e60d2a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:28.691358 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c950ffff-cc92-4449-a83c-0b89ca051e56 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:28.693318 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d611e1e1-12e4-469a-a5d1-663777e60d2a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:28.701174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d611e1e1-12e4-469a-a5d1-663777e60d2a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.257325 Jun 21 15:54:28.702934 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 62/125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:28 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:28.703520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c950ffff-cc92-4449-a83c-0b89ca051e56 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.276570 Jun 21 15:54:28.704092 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 64/126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:28 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:28.945620 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0e5a3cb0-651a-4dbf-8857-8e784693c1fd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:28.946257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0e5a3cb0-651a-4dbf-8857-8e784693c1fd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:28.952390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0e5a3cb0-651a-4dbf-8857-8e784693c1fd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:28.953028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0e5a3cb0-651a-4dbf-8857-8e784693c1fd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:28.953803 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0e5a3cb0-651a-4dbf-8857-8e784693c1fd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:28.954387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0e5a3cb0-651a-4dbf-8857-8e784693c1fd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:29.098370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:29.098974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:29.113819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:29.113819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:29.114129 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0e5a3cb0-651a-4dbf-8857-8e784693c1fd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:29.114238 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:29.114238 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:29.123672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0e5a3cb0-651a-4dbf-8857-8e784693c1fd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.181754 Jun 21 15:54:29.135629 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 63/127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:28 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:29.295966 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:29.307375 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:29.308975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:29.310197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f941179e-7b44-49b8-9cce-6ea907339200 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.216130 Jun 21 15:54:29.320460 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 65/128] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:29 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:29.720154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4a6834f2-b5c1-4fe8-b30d-cd6dab44c2ee tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:29.720494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1f8b0f11-bc24-4886-8112-0a3cf1be0ea6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:29.721099 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4a6834f2-b5c1-4fe8-b30d-cd6dab44c2ee tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:29.721220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1f8b0f11-bc24-4886-8112-0a3cf1be0ea6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:29.728488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1f8b0f11-bc24-4886-8112-0a3cf1be0ea6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:29.729244 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1f8b0f11-bc24-4886-8112-0a3cf1be0ea6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:29.730337 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1f8b0f11-bc24-4886-8112-0a3cf1be0ea6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:29.730757 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a6834f2-b5c1-4fe8-b30d-cd6dab44c2ee tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:29.730875 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1f8b0f11-bc24-4886-8112-0a3cf1be0ea6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:29.731487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a6834f2-b5c1-4fe8-b30d-cd6dab44c2ee tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:29.732795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a6834f2-b5c1-4fe8-b30d-cd6dab44c2ee tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:29.733432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a6834f2-b5c1-4fe8-b30d-cd6dab44c2ee tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:29.969405 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4a6834f2-b5c1-4fe8-b30d-cd6dab44c2ee tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:29.972971 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1f8b0f11-bc24-4886-8112-0a3cf1be0ea6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:29.985034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1f8b0f11-bc24-4886-8112-0a3cf1be0ea6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.268612 Jun 21 15:54:29.986007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 66/129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:29 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:29.989178 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4a6834f2-b5c1-4fe8-b30d-cd6dab44c2ee tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.268441 Jun 21 15:54:29.990301 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 64/130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:29 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:30.142643 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-864df512-393c-42c2-94ec-40ef12312f2c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:30.143292 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-864df512-393c-42c2-94ec-40ef12312f2c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:30.150235 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-864df512-393c-42c2-94ec-40ef12312f2c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:30.150680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-864df512-393c-42c2-94ec-40ef12312f2c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:30.151562 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-864df512-393c-42c2-94ec-40ef12312f2c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:30.151989 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-864df512-393c-42c2-94ec-40ef12312f2c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:30.155939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:30.292017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-864df512-393c-42c2-94ec-40ef12312f2c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:30.300475 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-864df512-393c-42c2-94ec-40ef12312f2c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.161874 Jun 21 15:54:30.300706 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 67/131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:30 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:30.328997 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:30.329821 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:30.336250 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:30.336713 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:30.337460 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:30.337909 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:30.474625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:30.485471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:30.486688 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:30.488389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1c16879b-b77c-450e-9ab0-de6672b42e14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.164211 Jun 21 15:54:30.488942 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 65/132] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:30 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:31.002949 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b73ffe4f-49c8-4b01-8973-91207991b938 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:31.003464 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b73ffe4f-49c8-4b01-8973-91207991b938 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:31.006888 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-be4242cb-48b6-4830-bc91-ecb95a7b0b3d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:31.007488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-be4242cb-48b6-4830-bc91-ecb95a7b0b3d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:31.009845 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b73ffe4f-49c8-4b01-8973-91207991b938 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:31.010293 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b73ffe4f-49c8-4b01-8973-91207991b938 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:31.011053 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b73ffe4f-49c8-4b01-8973-91207991b938 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:31.011480 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b73ffe4f-49c8-4b01-8973-91207991b938 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:31.013512 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-be4242cb-48b6-4830-bc91-ecb95a7b0b3d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:31.013986 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-be4242cb-48b6-4830-bc91-ecb95a7b0b3d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:31.014730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-be4242cb-48b6-4830-bc91-ecb95a7b0b3d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:31.015147 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-be4242cb-48b6-4830-bc91-ecb95a7b0b3d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:31.388698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b73ffe4f-49c8-4b01-8973-91207991b938 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:31.391866 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-be4242cb-48b6-4830-bc91-ecb95a7b0b3d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:31.397996 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b73ffe4f-49c8-4b01-8973-91207991b938 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.399241 Jun 21 15:54:31.398969 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 68/133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:30 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:31.399498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-be4242cb-48b6-4830-bc91-ecb95a7b0b3d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.396974 Jun 21 15:54:31.404235 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ed981d62-afee-4653-a026-48181f9f8717 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:31.405039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ed981d62-afee-4653-a026-48181f9f8717 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:31.408906 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 66/134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:31 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:31.411441 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ed981d62-afee-4653-a026-48181f9f8717 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:31.412079 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ed981d62-afee-4653-a026-48181f9f8717 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:31.412827 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ed981d62-afee-4653-a026-48181f9f8717 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:31.413255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ed981d62-afee-4653-a026-48181f9f8717 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:31.506324 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:31.507039 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:31.515514 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:31.516041 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:31.516883 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:31.517383 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:31.553174 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ed981d62-afee-4653-a026-48181f9f8717 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:31.560616 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ed981d62-afee-4653-a026-48181f9f8717 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.160133 Jun 21 15:54:31.561194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 69/135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:31 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:31.649701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:31.657966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:31.660001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:31.661201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-57b8aaa5-19b7-4a39-b0f4-71d3aeff86f0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.159253 Jun 21 15:54:31.661833 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 67/136] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:31 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:32.416583 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b917b4ae-95bd-4c90-9183-0aad5f0149ab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:32.417284 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fdc0c64b-ff62-49de-8f86-099b570157a9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:32.417646 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b917b4ae-95bd-4c90-9183-0aad5f0149ab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:32.417734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fdc0c64b-ff62-49de-8f86-099b570157a9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:32.424012 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b917b4ae-95bd-4c90-9183-0aad5f0149ab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:32.424455 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b917b4ae-95bd-4c90-9183-0aad5f0149ab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:32.424588 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fdc0c64b-ff62-49de-8f86-099b570157a9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:32.425205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fdc0c64b-ff62-49de-8f86-099b570157a9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:32.425471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b917b4ae-95bd-4c90-9183-0aad5f0149ab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:32.425936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b917b4ae-95bd-4c90-9183-0aad5f0149ab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:32.426488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fdc0c64b-ff62-49de-8f86-099b570157a9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:32.426919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fdc0c64b-ff62-49de-8f86-099b570157a9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:32.624010 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b917b4ae-95bd-4c90-9183-0aad5f0149ab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:32.629518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fdc0c64b-ff62-49de-8f86-099b570157a9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:32.635869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b917b4ae-95bd-4c90-9183-0aad5f0149ab tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.222845 Jun 21 15:54:32.636636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 68/137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:32 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:32.641918 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fdc0c64b-ff62-49de-8f86-099b570157a9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.229666 Jun 21 15:54:32.643182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 70/138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:32 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:32.644747 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5163d301-7c32-461c-b2e7-e5d7a81b1fae tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:32.645466 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5163d301-7c32-461c-b2e7-e5d7a81b1fae tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:32.651864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5163d301-7c32-461c-b2e7-e5d7a81b1fae tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:32.652311 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5163d301-7c32-461c-b2e7-e5d7a81b1fae tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:32.653106 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5163d301-7c32-461c-b2e7-e5d7a81b1fae tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:32.653534 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5163d301-7c32-461c-b2e7-e5d7a81b1fae tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:32.680135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:32.680933 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:32.689798 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:32.690366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:32.691434 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:32.691873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:32.845426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5163d301-7c32-461c-b2e7-e5d7a81b1fae tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:32.853565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5163d301-7c32-461c-b2e7-e5d7a81b1fae tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.215729 Jun 21 15:54:32.854255 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 69/139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:32 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:32.873098 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:32.881712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:32.883242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:32.884354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-89cf0f87-7357-4a1e-9169-7007630e8f32 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.208078 Jun 21 15:54:32.884916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 71/140] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:32 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:33.656016 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0573ba5b-3a3d-487b-9f1f-fbe1a83ce628 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:33.656569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0573ba5b-3a3d-487b-9f1f-fbe1a83ce628 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:33.658679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-01298543-04bf-4e27-8529-2e392e968ad8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:33.659430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-01298543-04bf-4e27-8529-2e392e968ad8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:33.664217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0573ba5b-3a3d-487b-9f1f-fbe1a83ce628 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:33.664710 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0573ba5b-3a3d-487b-9f1f-fbe1a83ce628 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:33.665481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0573ba5b-3a3d-487b-9f1f-fbe1a83ce628 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:33.665943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0573ba5b-3a3d-487b-9f1f-fbe1a83ce628 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:33.666182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-01298543-04bf-4e27-8529-2e392e968ad8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:33.666530 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-01298543-04bf-4e27-8529-2e392e968ad8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:33.667364 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-01298543-04bf-4e27-8529-2e392e968ad8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:33.667791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-01298543-04bf-4e27-8529-2e392e968ad8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:33.879793 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0573ba5b-3a3d-487b-9f1f-fbe1a83ce628 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:33.880013 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-01298543-04bf-4e27-8529-2e392e968ad8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:33.891023 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-01298543-04bf-4e27-8529-2e392e968ad8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.236098 Jun 21 15:54:33.891970 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 72/141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:33 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:33.896775 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2ba68375-261b-4b95-8fd9-a065ff6a8882 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:33.897366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2ba68375-261b-4b95-8fd9-a065ff6a8882 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:33.899723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0573ba5b-3a3d-487b-9f1f-fbe1a83ce628 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.247155 Jun 21 15:54:33.903996 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ba68375-261b-4b95-8fd9-a065ff6a8882 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:33.904947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ba68375-261b-4b95-8fd9-a065ff6a8882 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:33.906991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ba68375-261b-4b95-8fd9-a065ff6a8882 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:33.907578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ba68375-261b-4b95-8fd9-a065ff6a8882 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:33.910577 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 70/142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:33 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:33.915510 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:33.916112 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:33.924123 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:33.925103 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:33.927458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:33.928242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:34.126992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2ba68375-261b-4b95-8fd9-a065ff6a8882 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:34.135957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2ba68375-261b-4b95-8fd9-a065ff6a8882 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.243192 Jun 21 15:54:34.136546 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 73/143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:33 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:34.151019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:34.159258 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:34.160764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:34.161896 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-68f30cfb-9925-4e0e-b32c-fb8ccc880807 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.250265 Jun 21 15:54:34.162461 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 71/144] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:33 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:34.910163 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-07507bb2-6a04-4f53-bb59-8b1c8224edbc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:34.911148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-07507bb2-6a04-4f53-bb59-8b1c8224edbc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:34.918695 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7f2ea332-2dea-4633-bfdf-ecb8fecae866 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:34.919882 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7f2ea332-2dea-4633-bfdf-ecb8fecae866 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:34.920818 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-07507bb2-6a04-4f53-bb59-8b1c8224edbc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:34.921247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-07507bb2-6a04-4f53-bb59-8b1c8224edbc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:34.922067 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-07507bb2-6a04-4f53-bb59-8b1c8224edbc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:34.922500 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-07507bb2-6a04-4f53-bb59-8b1c8224edbc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:34.927297 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f2ea332-2dea-4633-bfdf-ecb8fecae866 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:34.927731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f2ea332-2dea-4633-bfdf-ecb8fecae866 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:34.928563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f2ea332-2dea-4633-bfdf-ecb8fecae866 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:34.928991 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f2ea332-2dea-4633-bfdf-ecb8fecae866 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:34.958766 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:35.149742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-07507bb2-6a04-4f53-bb59-8b1c8224edbc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:35.154961 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7f2ea332-2dea-4633-bfdf-ecb8fecae866 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:35.171291 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7f2ea332-2dea-4633-bfdf-ecb8fecae866 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.257555 Jun 21 15:54:35.171480 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-07507bb2-6a04-4f53-bb59-8b1c8224edbc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.265326 Jun 21 15:54:35.172150 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 74/145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:34 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:35.173965 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 72/146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:34 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:35.185621 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c143c222-3d48-4abf-949b-939ee44212bd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:35.186629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c143c222-3d48-4abf-949b-939ee44212bd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:35.195729 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:35.196961 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c143c222-3d48-4abf-949b-939ee44212bd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:35.197590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c143c222-3d48-4abf-949b-939ee44212bd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:35.197931 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:35.198442 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c143c222-3d48-4abf-949b-939ee44212bd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:35.199059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c143c222-3d48-4abf-949b-939ee44212bd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:35.212652 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:35.214390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:35.216361 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:35.217167 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:35.449554 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c143c222-3d48-4abf-949b-939ee44212bd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:35.464763 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c143c222-3d48-4abf-949b-939ee44212bd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.290955 Jun 21 15:54:35.465759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 75/147] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:35 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:35.473995 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:35.482502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:35.484983 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:35.486616 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9905dfff-c17e-4fc6-aa83-6e4d1497a29c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.302882 Jun 21 15:54:35.487946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 73/148] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:35 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:36.042954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-0fbf44d8-abfb-4732-93a1-c4068bcb49e9 req-4c4a1184-d23f-4f1d-945d-10a7376ca173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec4529a-7353-4e5e-9445-92924998e57c", "name": "network-vif-plugged", "status": "completed", "tag": "d17f1129-12c2-4041-a70f-9aac14587914"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:54:36.052036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0fbf44d8-abfb-4732-93a1-c4068bcb49e9 req-4c4a1184-d23f-4f1d-945d-10a7376ca173 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.052476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0fbf44d8-abfb-4732-93a1-c4068bcb49e9 req-4c4a1184-d23f-4f1d-945d-10a7376ca173 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.064641 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-0fbf44d8-abfb-4732-93a1-c4068bcb49e9 req-4c4a1184-d23f-4f1d-945d-10a7376ca173 service nova] Creating event network-vif-plugged:d17f1129-12c2-4041-a70f-9aac14587914 for instance aec4529a-7353-4e5e-9445-92924998e57c on hv-cinder-84067 Jun 21 15:54:36.070626 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-0fbf44d8-abfb-4732-93a1-c4068bcb49e9 req-4c4a1184-d23f-4f1d-945d-10a7376ca173 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091657 Jun 21 15:54:36.071213 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 76/149] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:54:36.188972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7532d86f-9d05-4310-9f13-38f8208463c3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:36.189612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7532d86f-9d05-4310-9f13-38f8208463c3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:36.195136 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-41d6bda5-3cbc-4309-9de1-a62f20fb9a81 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:36.195831 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-41d6bda5-3cbc-4309-9de1-a62f20fb9a81 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:36.199509 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7532d86f-9d05-4310-9f13-38f8208463c3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.199827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7532d86f-9d05-4310-9f13-38f8208463c3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.200600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7532d86f-9d05-4310-9f13-38f8208463c3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.200964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7532d86f-9d05-4310-9f13-38f8208463c3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.202564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41d6bda5-3cbc-4309-9de1-a62f20fb9a81 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.203153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41d6bda5-3cbc-4309-9de1-a62f20fb9a81 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.203926 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41d6bda5-3cbc-4309-9de1-a62f20fb9a81 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.204368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41d6bda5-3cbc-4309-9de1-a62f20fb9a81 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.418210 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7532d86f-9d05-4310-9f13-38f8208463c3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:36.422043 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-41d6bda5-3cbc-4309-9de1-a62f20fb9a81 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:36.428159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7532d86f-9d05-4310-9f13-38f8208463c3 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.243031 Jun 21 15:54:36.436805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 74/150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:36 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:36.437015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-41d6bda5-3cbc-4309-9de1-a62f20fb9a81 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.241435 Jun 21 15:54:36.437015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 77/151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:36 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:36.483398 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6529e133-e6d2-42c2-98a3-376292ad22e2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:36.484008 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6529e133-e6d2-42c2-98a3-376292ad22e2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:36.491264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6529e133-e6d2-42c2-98a3-376292ad22e2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.491728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6529e133-e6d2-42c2-98a3-376292ad22e2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.492488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6529e133-e6d2-42c2-98a3-376292ad22e2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.492910 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6529e133-e6d2-42c2-98a3-376292ad22e2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.505401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:36.506090 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:36.512468 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.512900 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.513650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:36.514115 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:36.717217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6529e133-e6d2-42c2-98a3-376292ad22e2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:36.737409 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6529e133-e6d2-42c2-98a3-376292ad22e2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.258456 Jun 21 15:54:36.737984 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 75/152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:36 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:36.747629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:36.756080 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:36.757574 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:36.758792 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fa393b09-4e23-451f-9c7c-db47f54975d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.258281 Jun 21 15:54:36.759359 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 78/153] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:36 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:37.447488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-514c252a-4f11-458e-bf79-1d9e901d7d9b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:37.448108 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-514c252a-4f11-458e-bf79-1d9e901d7d9b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:37.448579 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6fc58801-60c6-423c-8d5b-c935d74441d9 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:37.449191 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6fc58801-60c6-423c-8d5b-c935d74441d9 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:37.455514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6fc58801-60c6-423c-8d5b-c935d74441d9 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:37.455696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-514c252a-4f11-458e-bf79-1d9e901d7d9b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:37.455961 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6fc58801-60c6-423c-8d5b-c935d74441d9 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:37.456433 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-514c252a-4f11-458e-bf79-1d9e901d7d9b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:37.456743 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6fc58801-60c6-423c-8d5b-c935d74441d9 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:37.457172 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6fc58801-60c6-423c-8d5b-c935d74441d9 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:37.457578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-514c252a-4f11-458e-bf79-1d9e901d7d9b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:37.458107 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-514c252a-4f11-458e-bf79-1d9e901d7d9b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:37.673275 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-514c252a-4f11-458e-bf79-1d9e901d7d9b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:37.677486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6fc58801-60c6-423c-8d5b-c935d74441d9 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:37.681490 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-514c252a-4f11-458e-bf79-1d9e901d7d9b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.239164 Jun 21 15:54:37.682111 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 76/154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:37 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:37.687859 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6fc58801-60c6-423c-8d5b-c935d74441d9 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.242580 Jun 21 15:54:37.688872 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 79/155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:37 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:37.755675 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1e847b6b-00c4-4f3a-916c-e249ff871803 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:37.756719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1e847b6b-00c4-4f3a-916c-e249ff871803 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:37.763711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1e847b6b-00c4-4f3a-916c-e249ff871803 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:37.764598 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1e847b6b-00c4-4f3a-916c-e249ff871803 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:37.765363 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1e847b6b-00c4-4f3a-916c-e249ff871803 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:37.768918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1e847b6b-00c4-4f3a-916c-e249ff871803 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:37.777741 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:37.783045 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:37.800667 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:37.801387 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:37.802296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:37.803019 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:37.987563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1e847b6b-00c4-4f3a-916c-e249ff871803 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:37.996504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1e847b6b-00c4-4f3a-916c-e249ff871803 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.245202 Jun 21 15:54:37.999883 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 77/156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:37 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:38.000057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:38.008665 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:38.010224 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:38.011336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dfabad0f-f79c-4047-8e75-e2d9b79c353b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.237549 Jun 21 15:54:38.011850 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 80/157] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:37 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:38.699804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-79ddb6d8-d1a3-4d23-adbe-fc594bd8ac6e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:38.700360 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-79ddb6d8-d1a3-4d23-adbe-fc594bd8ac6e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:38.706838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-73a074c2-881f-4634-b449-db83a3003527 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:38.707427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-73a074c2-881f-4634-b449-db83a3003527 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:38.708449 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-79ddb6d8-d1a3-4d23-adbe-fc594bd8ac6e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:38.708967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-79ddb6d8-d1a3-4d23-adbe-fc594bd8ac6e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:38.709889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-79ddb6d8-d1a3-4d23-adbe-fc594bd8ac6e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:38.710411 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-79ddb6d8-d1a3-4d23-adbe-fc594bd8ac6e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:38.714331 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73a074c2-881f-4634-b449-db83a3003527 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:38.714756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73a074c2-881f-4634-b449-db83a3003527 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:38.715536 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73a074c2-881f-4634-b449-db83a3003527 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:38.715969 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73a074c2-881f-4634-b449-db83a3003527 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:38.912550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-79ddb6d8-d1a3-4d23-adbe-fc594bd8ac6e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:38.916172 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-73a074c2-881f-4634-b449-db83a3003527 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:38.920542 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-79ddb6d8-d1a3-4d23-adbe-fc594bd8ac6e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.224615 Jun 21 15:54:38.921114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 78/158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:38 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:38.923952 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-73a074c2-881f-4634-b449-db83a3003527 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.220896 Jun 21 15:54:38.924714 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 81/159] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:38 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:39.016557 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7f60d542-7f75-4d92-9d18-4e9ead21cf26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:39.017159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7f60d542-7f75-4d92-9d18-4e9ead21cf26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:39.023996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f60d542-7f75-4d92-9d18-4e9ead21cf26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:39.024419 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f60d542-7f75-4d92-9d18-4e9ead21cf26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:39.025180 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f60d542-7f75-4d92-9d18-4e9ead21cf26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:39.025608 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f60d542-7f75-4d92-9d18-4e9ead21cf26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:39.029643 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:39.030511 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:39.037459 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:39.038226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:39.039373 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:39.039854 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:39.247410 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7f60d542-7f75-4d92-9d18-4e9ead21cf26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:39.250797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:39.257345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7f60d542-7f75-4d92-9d18-4e9ead21cf26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.244606 Jun 21 15:54:39.257978 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 79/160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:39 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:39.259648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:39.261135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:39.262324 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cc1b560a-8a87-4490-acbe-d1c264f0c7fb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.236706 Jun 21 15:54:39.262823 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 82/161] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:39 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:39.936624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-00984761-6633-43f9-ba71-6cc201e8b47d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:39.937206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-00984761-6633-43f9-ba71-6cc201e8b47d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:39.940835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-73648934-a989-4f03-b71e-9a861113a46d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:39.941332 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-73648934-a989-4f03-b71e-9a861113a46d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:39.943387 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=97 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:39.943652 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-00984761-6633-43f9-ba71-6cc201e8b47d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:39.944081 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-00984761-6633-43f9-ba71-6cc201e8b47d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:39.944864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-00984761-6633-43f9-ba71-6cc201e8b47d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:39.945285 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-00984761-6633-43f9-ba71-6cc201e8b47d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:39.949179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73648934-a989-4f03-b71e-9a861113a46d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:39.949644 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73648934-a989-4f03-b71e-9a861113a46d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:39.950452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73648934-a989-4f03-b71e-9a861113a46d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:39.950928 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73648934-a989-4f03-b71e-9a861113a46d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:40.143749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-00984761-6633-43f9-ba71-6cc201e8b47d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:40.148187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-73648934-a989-4f03-b71e-9a861113a46d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:40.151745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-00984761-6633-43f9-ba71-6cc201e8b47d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.219061 Jun 21 15:54:40.152339 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 80/162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:39 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:40.155919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-73648934-a989-4f03-b71e-9a861113a46d tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.219098 Jun 21 15:54:40.156474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 83/163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:39 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:40.274441 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-57447c7d-6d17-4265-ab8d-beb9a7650b36 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:40.275028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-57447c7d-6d17-4265-ab8d-beb9a7650b36 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:40.281236 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57447c7d-6d17-4265-ab8d-beb9a7650b36 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:40.281677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57447c7d-6d17-4265-ab8d-beb9a7650b36 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:40.282379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:40.282518 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57447c7d-6d17-4265-ab8d-beb9a7650b36 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:40.282868 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57447c7d-6d17-4265-ab8d-beb9a7650b36 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:40.283274 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:40.290039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:40.290479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:40.291226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:40.291645 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:40.309874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:40.476635 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57447c7d-6d17-4265-ab8d-beb9a7650b36 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:40.484409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:40.484588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-57447c7d-6d17-4265-ab8d-beb9a7650b36 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.214427 Jun 21 15:54:40.485485 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 81/164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:40 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:40.496285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:40.498488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:40.500131 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-41c5efb6-15d0-42f0-b725-60e499acc144 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.221732 Jun 21 15:54:40.501013 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 84/165] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:40 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:41.169171 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-aae59d5b-4dcf-4c5e-8b05-e9fd5691d26e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:41.169701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-aae59d5b-4dcf-4c5e-8b05-e9fd5691d26e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:41.172495 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ecac322e-2fc2-4ccd-b5df-8f49c57ddd1f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:41.173225 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ecac322e-2fc2-4ccd-b5df-8f49c57ddd1f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:41.176491 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aae59d5b-4dcf-4c5e-8b05-e9fd5691d26e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:41.176939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aae59d5b-4dcf-4c5e-8b05-e9fd5691d26e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:41.177758 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aae59d5b-4dcf-4c5e-8b05-e9fd5691d26e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:41.178254 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aae59d5b-4dcf-4c5e-8b05-e9fd5691d26e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:41.179594 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ecac322e-2fc2-4ccd-b5df-8f49c57ddd1f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:41.180030 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ecac322e-2fc2-4ccd-b5df-8f49c57ddd1f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:41.180784 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ecac322e-2fc2-4ccd-b5df-8f49c57ddd1f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:41.181208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ecac322e-2fc2-4ccd-b5df-8f49c57ddd1f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:41.373389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-aae59d5b-4dcf-4c5e-8b05-e9fd5691d26e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:41.376567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ecac322e-2fc2-4ccd-b5df-8f49c57ddd1f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:41.381380 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-aae59d5b-4dcf-4c5e-8b05-e9fd5691d26e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.216074 Jun 21 15:54:41.382190 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 82/166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:41 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:41.385087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ecac322e-2fc2-4ccd-b5df-8f49c57ddd1f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.216372 Jun 21 15:54:41.385633 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 85/167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:41 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:41.507891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-21c31c88-5b41-4797-a316-b026886313eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:41.508622 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-21c31c88-5b41-4797-a316-b026886313eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:41.516392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21c31c88-5b41-4797-a316-b026886313eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:41.516836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21c31c88-5b41-4797-a316-b026886313eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:41.517632 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21c31c88-5b41-4797-a316-b026886313eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:41.518095 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21c31c88-5b41-4797-a316-b026886313eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:41.519640 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:41.520229 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:41.526577 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:41.526998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:41.527939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:41.528360 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:41.715032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:41.718275 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-21c31c88-5b41-4797-a316-b026886313eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:41.724640 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:41.726689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:41.728307 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-98724940-a13c-4752-a6fb-c76036e797a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.212345 Jun 21 15:54:41.737550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-21c31c88-5b41-4797-a316-b026886313eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.227066 Jun 21 15:54:41.738051 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 86/168] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:41 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:41.738127 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 83/169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:41 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:42.400427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0c34b21b-0fe4-48ef-b56a-612f7d729365 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:42.401012 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0c34b21b-0fe4-48ef-b56a-612f7d729365 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:42.402196 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-513b32c3-4498-44fd-82c8-b18cfdb695b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:42.402791 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-513b32c3-4498-44fd-82c8-b18cfdb695b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:42.407479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0c34b21b-0fe4-48ef-b56a-612f7d729365 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:42.407924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0c34b21b-0fe4-48ef-b56a-612f7d729365 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:42.408721 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0c34b21b-0fe4-48ef-b56a-612f7d729365 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:42.409145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0c34b21b-0fe4-48ef-b56a-612f7d729365 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:42.409278 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-513b32c3-4498-44fd-82c8-b18cfdb695b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:42.409715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-513b32c3-4498-44fd-82c8-b18cfdb695b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:42.410513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-513b32c3-4498-44fd-82c8-b18cfdb695b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:42.411313 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-513b32c3-4498-44fd-82c8-b18cfdb695b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:42.598570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0c34b21b-0fe4-48ef-b56a-612f7d729365 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:42.602306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-513b32c3-4498-44fd-82c8-b18cfdb695b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:42.607037 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0c34b21b-0fe4-48ef-b56a-612f7d729365 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.211383 Jun 21 15:54:42.607789 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 87/170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:42 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:42.610394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-513b32c3-4498-44fd-82c8-b18cfdb695b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.212235 Jun 21 15:54:42.611044 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 84/171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:42 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:42.746298 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3e902751-9977-43d9-9c8e-17882a6d7131 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:42.746530 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:42.746892 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3e902751-9977-43d9-9c8e-17882a6d7131 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:42.747029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:42.753591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3e902751-9977-43d9-9c8e-17882a6d7131 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:42.754095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3e902751-9977-43d9-9c8e-17882a6d7131 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:42.754846 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3e902751-9977-43d9-9c8e-17882a6d7131 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:42.755393 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3e902751-9977-43d9-9c8e-17882a6d7131 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:42.755704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:42.756577 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:42.757474 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:42.757967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:42.955882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3e902751-9977-43d9-9c8e-17882a6d7131 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:42.959864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:42.964640 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3e902751-9977-43d9-9c8e-17882a6d7131 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.222075 Jun 21 15:54:42.965217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 88/172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:42 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:42.968395 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:42.970079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:42.973105 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-867022f8-49f4-40ec-baff-c8ecb451eda3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.230031 Jun 21 15:54:42.981912 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 85/173] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:42 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:43.623930 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-81f710c4-5e9c-4e27-a96e-8486a1ba4a58 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:43.624499 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-81f710c4-5e9c-4e27-a96e-8486a1ba4a58 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:43.627194 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-19b52015-963b-40e3-8461-80d3998e710b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:43.627795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-19b52015-963b-40e3-8461-80d3998e710b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:43.631363 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81f710c4-5e9c-4e27-a96e-8486a1ba4a58 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:43.631637 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81f710c4-5e9c-4e27-a96e-8486a1ba4a58 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:43.632398 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81f710c4-5e9c-4e27-a96e-8486a1ba4a58 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:43.632824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81f710c4-5e9c-4e27-a96e-8486a1ba4a58 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:43.634832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19b52015-963b-40e3-8461-80d3998e710b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:43.635310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19b52015-963b-40e3-8461-80d3998e710b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:43.636079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19b52015-963b-40e3-8461-80d3998e710b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:43.637931 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19b52015-963b-40e3-8461-80d3998e710b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:43.835063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-81f710c4-5e9c-4e27-a96e-8486a1ba4a58 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:43.841522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-19b52015-963b-40e3-8461-80d3998e710b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:43.847045 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-81f710c4-5e9c-4e27-a96e-8486a1ba4a58 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.226964 Jun 21 15:54:43.847719 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 89/174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:43 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:43.852448 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-19b52015-963b-40e3-8461-80d3998e710b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.228983 Jun 21 15:54:43.853199 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 86/175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:43 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:43.987038 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-400767ad-65cf-4b1b-abf6-62c619b66f2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:43.987678 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-400767ad-65cf-4b1b-abf6-62c619b66f2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:43.995060 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-400767ad-65cf-4b1b-abf6-62c619b66f2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:43.995548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-400767ad-65cf-4b1b-abf6-62c619b66f2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:43.996308 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-400767ad-65cf-4b1b-abf6-62c619b66f2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:43.996601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:43.996752 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-400767ad-65cf-4b1b-abf6-62c619b66f2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:43.997202 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:44.003331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:44.003778 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:44.004521 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:44.004943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:44.220941 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-400767ad-65cf-4b1b-abf6-62c619b66f2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:44.227131 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:44.233600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-400767ad-65cf-4b1b-abf6-62c619b66f2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.254617 Jun 21 15:54:44.234781 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 90/176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:43 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:44.243596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:44.245862 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:44.247256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c255af9a-8792-41c2-aa5b-fbcb09a6181c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.255399 Jun 21 15:54:44.247968 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 87/177] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:43 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:44.865114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a2d1fca4-3df5-4c58-a393-377c2dd96870 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:44.866223 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a2d1fca4-3df5-4c58-a393-377c2dd96870 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:44.869209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a6a413d2-043c-4b3d-8d06-a6b79f94f70b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:44.870049 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a6a413d2-043c-4b3d-8d06-a6b79f94f70b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:44.873299 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a2d1fca4-3df5-4c58-a393-377c2dd96870 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:44.873867 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a2d1fca4-3df5-4c58-a393-377c2dd96870 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:44.874844 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a2d1fca4-3df5-4c58-a393-377c2dd96870 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:44.875237 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a2d1fca4-3df5-4c58-a393-377c2dd96870 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:44.879206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a6a413d2-043c-4b3d-8d06-a6b79f94f70b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:44.879670 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a6a413d2-043c-4b3d-8d06-a6b79f94f70b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:44.880492 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a6a413d2-043c-4b3d-8d06-a6b79f94f70b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:44.880908 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a6a413d2-043c-4b3d-8d06-a6b79f94f70b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:45.086089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a2d1fca4-3df5-4c58-a393-377c2dd96870 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:45.097106 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a2d1fca4-3df5-4c58-a393-377c2dd96870 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.236342 Jun 21 15:54:45.098492 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 91/178] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:44 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:45.130682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-dd282f17-78eb-4a44-a2ee-13527258a55f req-54e94acd-913c-4225-8767-12da15898b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899aef0a-2cf7-47b2-9b08-0068bde58dae", "name": "network-vif-plugged", "status": "completed", "tag": "6288bac4-2f2c-42ad-9eca-74ece6209900"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:54:45.151916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-dd282f17-78eb-4a44-a2ee-13527258a55f req-54e94acd-913c-4225-8767-12da15898b15 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:45.152743 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-dd282f17-78eb-4a44-a2ee-13527258a55f req-54e94acd-913c-4225-8767-12da15898b15 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:45.170200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a6a413d2-043c-4b3d-8d06-a6b79f94f70b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:45.183985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a6a413d2-043c-4b3d-8d06-a6b79f94f70b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.313613 Jun 21 15:54:45.184120 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-dd282f17-78eb-4a44-a2ee-13527258a55f req-54e94acd-913c-4225-8767-12da15898b15 service nova] Creating event network-vif-plugged:6288bac4-2f2c-42ad-9eca-74ece6209900 for instance 899aef0a-2cf7-47b2-9b08-0068bde58dae on hv-cinder-84067 Jun 21 15:54:45.196183 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 88/179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:44 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:45.197270 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-dd282f17-78eb-4a44-a2ee-13527258a55f req-54e94acd-913c-4225-8767-12da15898b15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073290 Jun 21 15:54:45.198169 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 92/180] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:54:45.252174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-594258ea-ae8d-47c9-8ce1-32263844ebe3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:45.252832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-594258ea-ae8d-47c9-8ce1-32263844ebe3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:45.259749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-594258ea-ae8d-47c9-8ce1-32263844ebe3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:45.260461 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-594258ea-ae8d-47c9-8ce1-32263844ebe3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:45.261469 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-594258ea-ae8d-47c9-8ce1-32263844ebe3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:45.262003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-594258ea-ae8d-47c9-8ce1-32263844ebe3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:45.266407 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:45.267099 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:45.269040 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:45.282324 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:45.282778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:45.288638 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:45.289192 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:45.566810 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-594258ea-ae8d-47c9-8ce1-32263844ebe3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:45.574426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-594258ea-ae8d-47c9-8ce1-32263844ebe3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.326743 Jun 21 15:54:45.575008 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 89/181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:45 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:45.600647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:45.609671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:45.611152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:45.612258 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7fcafdc8-08d3-4b2c-aff9-8a7fdf25e2e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.350530 Jun 21 15:54:45.612819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 93/182] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:45 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:46.115377 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d9b48962-0724-4f33-ad9f-5f2568c3f7d7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:46.116029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d9b48962-0724-4f33-ad9f-5f2568c3f7d7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:46.122304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9b48962-0724-4f33-ad9f-5f2568c3f7d7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:46.122744 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9b48962-0724-4f33-ad9f-5f2568c3f7d7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:46.123488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9b48962-0724-4f33-ad9f-5f2568c3f7d7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:46.123944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9b48962-0724-4f33-ad9f-5f2568c3f7d7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:46.200723 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b468026b-5888-4e4c-95f5-8301ff2707ba tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:46.201512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b468026b-5888-4e4c-95f5-8301ff2707ba tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:46.207959 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b468026b-5888-4e4c-95f5-8301ff2707ba tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:46.208569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b468026b-5888-4e4c-95f5-8301ff2707ba tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:46.209391 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b468026b-5888-4e4c-95f5-8301ff2707ba tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:46.209822 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b468026b-5888-4e4c-95f5-8301ff2707ba tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:46.308780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d9b48962-0724-4f33-ad9f-5f2568c3f7d7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:46.318726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d9b48962-0724-4f33-ad9f-5f2568c3f7d7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.207315 Jun 21 15:54:46.319569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 90/183] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:46 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:46.396029 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b468026b-5888-4e4c-95f5-8301ff2707ba tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:46.403653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b468026b-5888-4e4c-95f5-8301ff2707ba tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.206772 Jun 21 15:54:46.404178 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 94/184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:46 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:46.592214 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c849700b-b54a-4a7e-9a6c-7404353930e9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:46.592845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c849700b-b54a-4a7e-9a6c-7404353930e9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:46.599270 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c849700b-b54a-4a7e-9a6c-7404353930e9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:46.599717 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c849700b-b54a-4a7e-9a6c-7404353930e9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:46.600464 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c849700b-b54a-4a7e-9a6c-7404353930e9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:46.600891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c849700b-b54a-4a7e-9a6c-7404353930e9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:46.635342 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:46.636009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:46.642639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:46.643372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:46.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:46.644714 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:46.822295 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c849700b-b54a-4a7e-9a6c-7404353930e9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:46.831236 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c849700b-b54a-4a7e-9a6c-7404353930e9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.242723 Jun 21 15:54:46.831810 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 91/185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:46 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:46.848678 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:46.857604 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:46.859128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:46.860241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7697dfd4-671e-45c0-84a5-e4eda8a6d796 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.231515 Jun 21 15:54:46.860792 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 95/186] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:46 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:47.338030 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0b0d4bee-6ff9-4d80-b8a7-53c7ef125596 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:47.338610 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0b0d4bee-6ff9-4d80-b8a7-53c7ef125596 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:47.340526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=97 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:47.346283 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0b0d4bee-6ff9-4d80-b8a7-53c7ef125596 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:47.346708 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0b0d4bee-6ff9-4d80-b8a7-53c7ef125596 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:47.347515 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0b0d4bee-6ff9-4d80-b8a7-53c7ef125596 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:47.347936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0b0d4bee-6ff9-4d80-b8a7-53c7ef125596 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:47.421441 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6d83d4e9-8ef4-4cbe-8389-38a1635dc771 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:47.422088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6d83d4e9-8ef4-4cbe-8389-38a1635dc771 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:47.429449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d83d4e9-8ef4-4cbe-8389-38a1635dc771 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:47.429449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d83d4e9-8ef4-4cbe-8389-38a1635dc771 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:47.430268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d83d4e9-8ef4-4cbe-8389-38a1635dc771 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:47.430837 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d83d4e9-8ef4-4cbe-8389-38a1635dc771 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:47.533483 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0b0d4bee-6ff9-4d80-b8a7-53c7ef125596 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:47.537153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0b0d4bee-6ff9-4d80-b8a7-53c7ef125596 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.202879 Jun 21 15:54:47.537968 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 92/187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:47 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:47.601170 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6d83d4e9-8ef4-4cbe-8389-38a1635dc771 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:47.609299 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6d83d4e9-8ef4-4cbe-8389-38a1635dc771 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.191773 Jun 21 15:54:47.610042 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 96/188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:47 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:47.849916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8daed0d4-18f6-4157-a0c2-f8b7baa903af tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:47.850520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8daed0d4-18f6-4157-a0c2-f8b7baa903af tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:47.857361 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8daed0d4-18f6-4157-a0c2-f8b7baa903af tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:47.857813 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8daed0d4-18f6-4157-a0c2-f8b7baa903af tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:47.858579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8daed0d4-18f6-4157-a0c2-f8b7baa903af tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:47.859007 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8daed0d4-18f6-4157-a0c2-f8b7baa903af tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:47.878716 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:47.879311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:47.885974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:47.886425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:47.887203 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:47.887634 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:48.228645 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8daed0d4-18f6-4157-a0c2-f8b7baa903af tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:48.237032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8daed0d4-18f6-4157-a0c2-f8b7baa903af tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.391277 Jun 21 15:54:48.237891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 93/189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:47 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:48.244079 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:48.252997 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:48.254554 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:48.255688 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dc799935-a380-431c-b153-631eeac31a50 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.381105 Jun 21 15:54:48.256271 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 97/190] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:47 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:48.554759 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5ba5881e-3d3a-4b87-bfc9-537bb640f721 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:48.555350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5ba5881e-3d3a-4b87-bfc9-537bb640f721 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:48.561762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5ba5881e-3d3a-4b87-bfc9-537bb640f721 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:48.562258 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5ba5881e-3d3a-4b87-bfc9-537bb640f721 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:48.563006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5ba5881e-3d3a-4b87-bfc9-537bb640f721 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:48.563430 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5ba5881e-3d3a-4b87-bfc9-537bb640f721 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:48.626531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-86f8a4e0-2ca7-4767-b279-94ce7b029c97 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:48.627158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-86f8a4e0-2ca7-4767-b279-94ce7b029c97 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:48.634391 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86f8a4e0-2ca7-4767-b279-94ce7b029c97 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:48.634866 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86f8a4e0-2ca7-4767-b279-94ce7b029c97 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:48.635949 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86f8a4e0-2ca7-4767-b279-94ce7b029c97 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:48.636365 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86f8a4e0-2ca7-4767-b279-94ce7b029c97 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:48.739648 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5ba5881e-3d3a-4b87-bfc9-537bb640f721 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:48.750978 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5ba5881e-3d3a-4b87-bfc9-537bb640f721 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.199970 Jun 21 15:54:48.751778 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 94/191] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:48 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:48.793327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-86f8a4e0-2ca7-4767-b279-94ce7b029c97 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:48.801522 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-86f8a4e0-2ca7-4767-b279-94ce7b029c97 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.178990 Jun 21 15:54:48.802194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 98/192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:48 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:49.256384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ca64a103-2df1-4fed-8f5b-fcabc8e8cb6b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:49.256978 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ca64a103-2df1-4fed-8f5b-fcabc8e8cb6b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:49.263414 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ca64a103-2df1-4fed-8f5b-fcabc8e8cb6b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:49.263843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ca64a103-2df1-4fed-8f5b-fcabc8e8cb6b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:49.264585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ca64a103-2df1-4fed-8f5b-fcabc8e8cb6b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:49.265003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ca64a103-2df1-4fed-8f5b-fcabc8e8cb6b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:49.275021 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:49.275715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:49.282328 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:49.282773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:49.283536 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:49.284132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:49.463447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ca64a103-2df1-4fed-8f5b-fcabc8e8cb6b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:49.471645 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ca64a103-2df1-4fed-8f5b-fcabc8e8cb6b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.221129 Jun 21 15:54:49.472211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 95/193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:49 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:49.479336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:49.488021 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:49.489533 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:49.490757 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9d4e764d-fe87-46f9-81e7-3733ecd991bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.220297 Jun 21 15:54:49.491656 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 99/194] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:49 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:49.770388 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-69586629-d146-41a3-8d8e-b07aa775b051 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:49.771468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-69586629-d146-41a3-8d8e-b07aa775b051 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:49.777648 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-69586629-d146-41a3-8d8e-b07aa775b051 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:49.778159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-69586629-d146-41a3-8d8e-b07aa775b051 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:49.778894 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-69586629-d146-41a3-8d8e-b07aa775b051 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:49.779281 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-69586629-d146-41a3-8d8e-b07aa775b051 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:49.818918 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6ea5735c-d468-44e8-8b89-f2da12475af0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:49.819604 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6ea5735c-d468-44e8-8b89-f2da12475af0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:49.826233 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ea5735c-d468-44e8-8b89-f2da12475af0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:49.826760 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ea5735c-d468-44e8-8b89-f2da12475af0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:49.827598 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ea5735c-d468-44e8-8b89-f2da12475af0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:49.828096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ea5735c-d468-44e8-8b89-f2da12475af0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:49.968395 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-69586629-d146-41a3-8d8e-b07aa775b051 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:49.977961 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-69586629-d146-41a3-8d8e-b07aa775b051 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.211347 Jun 21 15:54:49.978897 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 96/195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:49 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:50.006067 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6ea5735c-d468-44e8-8b89-f2da12475af0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:50.012718 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6ea5735c-d468-44e8-8b89-f2da12475af0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.197507 Jun 21 15:54:50.013617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 100/196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:49 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:50.488579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-96471750-708b-4192-99f0-808bd8f1a4a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:50.489178 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-96471750-708b-4192-99f0-808bd8f1a4a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:50.495480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-96471750-708b-4192-99f0-808bd8f1a4a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:50.495985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-96471750-708b-4192-99f0-808bd8f1a4a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:50.496728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-96471750-708b-4192-99f0-808bd8f1a4a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:50.497157 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-96471750-708b-4192-99f0-808bd8f1a4a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:50.508850 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:50.509491 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:50.516146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:50.516870 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:50.517603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:50.518110 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:50.703191 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-96471750-708b-4192-99f0-808bd8f1a4a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:50.712265 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-96471750-708b-4192-99f0-808bd8f1a4a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.227516 Jun 21 15:54:50.712862 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 97/197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:50 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:50.728615 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:50.732587 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:50.738141 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:50.739651 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:50.740824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5833aedc-3cde-478c-937f-919077c3f859 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.236194 Jun 21 15:54:50.741382 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 101/198] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:50 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:50.997300 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-80284966-d42c-4fca-ac5c-26e15f75871f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:50.997928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-80284966-d42c-4fca-ac5c-26e15f75871f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:51.004229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-80284966-d42c-4fca-ac5c-26e15f75871f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:51.004687 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-80284966-d42c-4fca-ac5c-26e15f75871f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:51.005604 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-80284966-d42c-4fca-ac5c-26e15f75871f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:51.006215 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-80284966-d42c-4fca-ac5c-26e15f75871f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:51.030847 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7ce0dcba-fd15-49f6-b22d-2eb965a29da7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:51.031429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7ce0dcba-fd15-49f6-b22d-2eb965a29da7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:51.038100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ce0dcba-fd15-49f6-b22d-2eb965a29da7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:51.038538 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ce0dcba-fd15-49f6-b22d-2eb965a29da7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:51.039469 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ce0dcba-fd15-49f6-b22d-2eb965a29da7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:51.039807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ce0dcba-fd15-49f6-b22d-2eb965a29da7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:51.207533 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-80284966-d42c-4fca-ac5c-26e15f75871f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:51.214593 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7ce0dcba-fd15-49f6-b22d-2eb965a29da7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:51.215745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-80284966-d42c-4fca-ac5c-26e15f75871f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.223055 Jun 21 15:54:51.216319 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 98/199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:50 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:51.222455 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7ce0dcba-fd15-49f6-b22d-2eb965a29da7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.195601 Jun 21 15:54:51.223041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 102/200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:51 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:51.730005 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8a355dab-c2ce-4baa-b375-bee5e955b8b7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:51.730938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8a355dab-c2ce-4baa-b375-bee5e955b8b7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:51.737514 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8a355dab-c2ce-4baa-b375-bee5e955b8b7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:51.738079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8a355dab-c2ce-4baa-b375-bee5e955b8b7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:51.738859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8a355dab-c2ce-4baa-b375-bee5e955b8b7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:51.739239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8a355dab-c2ce-4baa-b375-bee5e955b8b7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:51.760549 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:51.761436 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:51.769736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:51.770207 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:51.770968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:51.771417 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:51.948749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8a355dab-c2ce-4baa-b375-bee5e955b8b7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:51.957963 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8a355dab-c2ce-4baa-b375-bee5e955b8b7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.231771 Jun 21 15:54:51.958589 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 99/201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:51 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:51.963196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:51.973620 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:51.975898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:51.977525 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-13e06502-a85a-4583-8105-404a3993923c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.222012 Jun 21 15:54:51.978453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 103/202] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:51 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:52.235854 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ccdf527d-43b3-41df-bc34-73ef5756bad1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:52.236712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ccdf527d-43b3-41df-bc34-73ef5756bad1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:52.244124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ccdf527d-43b3-41df-bc34-73ef5756bad1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:52.244660 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ccdf527d-43b3-41df-bc34-73ef5756bad1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:52.245495 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ccdf527d-43b3-41df-bc34-73ef5756bad1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:52.246102 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ccdf527d-43b3-41df-bc34-73ef5756bad1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:52.246858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ddd1e4c5-d7a6-45dd-b6b3-8add84f269b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:52.247466 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ddd1e4c5-d7a6-45dd-b6b3-8add84f269b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:52.253747 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ddd1e4c5-d7a6-45dd-b6b3-8add84f269b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:52.254419 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ddd1e4c5-d7a6-45dd-b6b3-8add84f269b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:52.255135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ddd1e4c5-d7a6-45dd-b6b3-8add84f269b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:52.255740 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ddd1e4c5-d7a6-45dd-b6b3-8add84f269b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:52.450574 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ccdf527d-43b3-41df-bc34-73ef5756bad1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:52.453694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ddd1e4c5-d7a6-45dd-b6b3-8add84f269b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:52.458196 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ccdf527d-43b3-41df-bc34-73ef5756bad1 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.228124 Jun 21 15:54:52.459158 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 100/203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:52 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:52.462147 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ddd1e4c5-d7a6-45dd-b6b3-8add84f269b4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.222477 Jun 21 15:54:52.462735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 104/204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:52 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:52.975940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-faf3f960-9e71-4652-8295-c0560f6437b5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:52.976589 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-faf3f960-9e71-4652-8295-c0560f6437b5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:53.000125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:53.001088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:53.003669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-faf3f960-9e71-4652-8295-c0560f6437b5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.004139 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-faf3f960-9e71-4652-8295-c0560f6437b5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.008021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-faf3f960-9e71-4652-8295-c0560f6437b5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.010016 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-faf3f960-9e71-4652-8295-c0560f6437b5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.013249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.014648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.016205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.016910 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.264994 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-faf3f960-9e71-4652-8295-c0560f6437b5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:53.277706 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-faf3f960-9e71-4652-8295-c0560f6437b5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.306408 Jun 21 15:54:53.286616 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 101/205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:52 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:53.287611 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:53.296560 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:53.298240 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:53.299402 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b3616cd9-026b-45e5-be92-ad5de4ea139b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.306637 Jun 21 15:54:53.299964 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 105/206] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:52 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:53.481267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a905c0dc-2fdf-4451-a7e5-8dc70ef9f150 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:53.482221 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a905c0dc-2fdf-4451-a7e5-8dc70ef9f150 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:53.483810 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-329816ca-7e64-490d-8ca2-8a052123b60e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:53.484445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-329816ca-7e64-490d-8ca2-8a052123b60e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:53.492274 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a905c0dc-2fdf-4451-a7e5-8dc70ef9f150 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.494776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a905c0dc-2fdf-4451-a7e5-8dc70ef9f150 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.495751 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a905c0dc-2fdf-4451-a7e5-8dc70ef9f150 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.497335 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a905c0dc-2fdf-4451-a7e5-8dc70ef9f150 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.500498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-329816ca-7e64-490d-8ca2-8a052123b60e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.501110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-329816ca-7e64-490d-8ca2-8a052123b60e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.502047 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-329816ca-7e64-490d-8ca2-8a052123b60e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.502484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-329816ca-7e64-490d-8ca2-8a052123b60e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.833349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-329816ca-7e64-490d-8ca2-8a052123b60e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:53.845595 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-329816ca-7e64-490d-8ca2-8a052123b60e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.372136 Jun 21 15:54:53.846941 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 102/207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:53 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:53.853680 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-89ce55c4-34a1-441a-b49d-78400f9ecf00 req-40d170e1-fcee-4fe1-8b41-7c3d590fca38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f494bc-2b5c-48f9-9842-5982a0d81192", "name": "network-vif-plugged", "status": "completed", "tag": "c891b3c8-5701-448e-86d1-f82bb6aa0a97"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:54:53.861443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a905c0dc-2fdf-4451-a7e5-8dc70ef9f150 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:53.879465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-89ce55c4-34a1-441a-b49d-78400f9ecf00 req-40d170e1-fcee-4fe1-8b41-7c3d590fca38 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:53.880465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-89ce55c4-34a1-441a-b49d-78400f9ecf00 req-40d170e1-fcee-4fe1-8b41-7c3d590fca38 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:53.885515 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a905c0dc-2fdf-4451-a7e5-8dc70ef9f150 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.408468 Jun 21 15:54:53.887043 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 106/208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:53 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:53.899725 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-89ce55c4-34a1-441a-b49d-78400f9ecf00 req-40d170e1-fcee-4fe1-8b41-7c3d590fca38 service nova] Creating event network-vif-plugged:c891b3c8-5701-448e-86d1-f82bb6aa0a97 for instance c6f494bc-2b5c-48f9-9842-5982a0d81192 on hv-cinder-84067 Jun 21 15:54:53.905950 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-89ce55c4-34a1-441a-b49d-78400f9ecf00 req-40d170e1-fcee-4fe1-8b41-7c3d590fca38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057410 Jun 21 15:54:53.906789 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 103/209] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:54:54.297182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1bc351ab-7249-47b9-be43-c2add8ab9be0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:54.298041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1bc351ab-7249-47b9-be43-c2add8ab9be0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:54.306134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1bc351ab-7249-47b9-be43-c2add8ab9be0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:54.306636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1bc351ab-7249-47b9-be43-c2add8ab9be0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:54.307464 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1bc351ab-7249-47b9-be43-c2add8ab9be0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:54.307948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1bc351ab-7249-47b9-be43-c2add8ab9be0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:54.319244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:54.320520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:54.328636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:54.329383 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:54.330427 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:54.331053 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:54.592429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1bc351ab-7249-47b9-be43-c2add8ab9be0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:54.601057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1bc351ab-7249-47b9-be43-c2add8ab9be0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.307940 Jun 21 15:54:54.602044 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 107/210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:54 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:54.631042 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:54.639860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:54.641350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:54.642548 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c08b25e8-9f2c-4aa1-a77e-43c699c96ede tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.328245 Jun 21 15:54:54.643049 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 104/211] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:54 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:54.871025 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-74ceb21f-c7b5-44bb-97d6-c76a0fe57c8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:54.871634 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-74ceb21f-c7b5-44bb-97d6-c76a0fe57c8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:54.877964 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74ceb21f-c7b5-44bb-97d6-c76a0fe57c8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:54.878401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74ceb21f-c7b5-44bb-97d6-c76a0fe57c8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:54.879149 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74ceb21f-c7b5-44bb-97d6-c76a0fe57c8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:54.879571 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74ceb21f-c7b5-44bb-97d6-c76a0fe57c8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:54.906266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a474cba4-e674-4fde-9e2e-3a0ee39b82e8 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:54.907065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a474cba4-e674-4fde-9e2e-3a0ee39b82e8 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:54.914843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a474cba4-e674-4fde-9e2e-3a0ee39b82e8 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:54.915522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a474cba4-e674-4fde-9e2e-3a0ee39b82e8 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:54.916608 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a474cba4-e674-4fde-9e2e-3a0ee39b82e8 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:54.917240 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a474cba4-e674-4fde-9e2e-3a0ee39b82e8 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:55.131022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a474cba4-e674-4fde-9e2e-3a0ee39b82e8 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:55.143366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-74ceb21f-c7b5-44bb-97d6-c76a0fe57c8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:55.145054 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a474cba4-e674-4fde-9e2e-3a0ee39b82e8 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.242880 Jun 21 15:54:55.145876 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 105/212] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:54 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:55.151263 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-74ceb21f-c7b5-44bb-97d6-c76a0fe57c8b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.284577 Jun 21 15:54:55.151830 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 108/213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:54 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:55.619372 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3fff2b1f-a19f-49a5-bf5d-b26959aab34d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:55.619957 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3fff2b1f-a19f-49a5-bf5d-b26959aab34d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:55.626657 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3fff2b1f-a19f-49a5-bf5d-b26959aab34d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:55.627097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3fff2b1f-a19f-49a5-bf5d-b26959aab34d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:55.627872 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3fff2b1f-a19f-49a5-bf5d-b26959aab34d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:55.628307 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3fff2b1f-a19f-49a5-bf5d-b26959aab34d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:55.647321 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:55.660472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:55.661065 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:55.668133 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:55.668565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:55.669357 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:55.669808 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:55.831787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3fff2b1f-a19f-49a5-bf5d-b26959aab34d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:55.839541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3fff2b1f-a19f-49a5-bf5d-b26959aab34d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.224021 Jun 21 15:54:55.840095 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 106/214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:55 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:55.859298 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:55.867960 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:55.869453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:55.871334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8ca15a51-5c53-4a83-9e7c-d38100fd5a14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.214749 Jun 21 15:54:55.871898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 109/215] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:55 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:54:56.166118 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c32af6fb-7231-4739-b522-ee845e32a2bd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:56.166740 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c32af6fb-7231-4739-b522-ee845e32a2bd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:56.173405 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c32af6fb-7231-4739-b522-ee845e32a2bd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:56.173875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c32af6fb-7231-4739-b522-ee845e32a2bd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:56.174618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c32af6fb-7231-4739-b522-ee845e32a2bd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:56.175045 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c32af6fb-7231-4739-b522-ee845e32a2bd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:56.175849 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7ec41bcc-c375-4d7e-b55f-33f339a819a2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:56.176465 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7ec41bcc-c375-4d7e-b55f-33f339a819a2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:56.183492 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ec41bcc-c375-4d7e-b55f-33f339a819a2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:56.183927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ec41bcc-c375-4d7e-b55f-33f339a819a2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:56.184673 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ec41bcc-c375-4d7e-b55f-33f339a819a2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:56.185097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ec41bcc-c375-4d7e-b55f-33f339a819a2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:56.373387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c32af6fb-7231-4739-b522-ee845e32a2bd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:56.376398 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7ec41bcc-c375-4d7e-b55f-33f339a819a2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:56.383644 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c32af6fb-7231-4739-b522-ee845e32a2bd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.221472 Jun 21 15:54:56.384578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 107/216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:56 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:56.385220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7ec41bcc-c375-4d7e-b55f-33f339a819a2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.212082 Jun 21 15:54:56.386238 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 110/217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:56 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:54:56.857186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-10b7637d-d11c-4059-bbaa-f95973759593 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:56.857768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-10b7637d-d11c-4059-bbaa-f95973759593 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:56.864937 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-10b7637d-d11c-4059-bbaa-f95973759593 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:56.865426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-10b7637d-d11c-4059-bbaa-f95973759593 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:56.866230 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-10b7637d-d11c-4059-bbaa-f95973759593 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:56.866669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-10b7637d-d11c-4059-bbaa-f95973759593 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:56.888771 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:56.889615 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:56.898225 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:56.898664 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:56.899425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:56.899851 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:57.057928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-10b7637d-d11c-4059-bbaa-f95973759593 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:57.065853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-10b7637d-d11c-4059-bbaa-f95973759593 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.212989 Jun 21 15:54:57.066451 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 108/218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:56 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:57.081370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:57.094996 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:57.096610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:57.097890 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-58f6d0e4-f1e3-4301-8f85-492fd6a05363 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.213122 Jun 21 15:54:57.098582 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 111/219] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:56 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:57.402488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-92c9c433-6b79-4e9a-8945-96a4cbe5c5bb tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:57.403008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0ea6dff6-5100-45f6-bd07-3cd3b47dcde7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:57.403142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-92c9c433-6b79-4e9a-8945-96a4cbe5c5bb tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:57.403612 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0ea6dff6-5100-45f6-bd07-3cd3b47dcde7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:57.409820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-92c9c433-6b79-4e9a-8945-96a4cbe5c5bb tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:57.410028 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0ea6dff6-5100-45f6-bd07-3cd3b47dcde7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:57.410257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-92c9c433-6b79-4e9a-8945-96a4cbe5c5bb tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:57.410465 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0ea6dff6-5100-45f6-bd07-3cd3b47dcde7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:57.411012 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-92c9c433-6b79-4e9a-8945-96a4cbe5c5bb tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:57.411345 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0ea6dff6-5100-45f6-bd07-3cd3b47dcde7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:57.411484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-92c9c433-6b79-4e9a-8945-96a4cbe5c5bb tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:57.411774 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0ea6dff6-5100-45f6-bd07-3cd3b47dcde7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:57.616079 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0ea6dff6-5100-45f6-bd07-3cd3b47dcde7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:57.623949 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-92c9c433-6b79-4e9a-8945-96a4cbe5c5bb tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:57.624108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0ea6dff6-5100-45f6-bd07-3cd3b47dcde7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.224775 Jun 21 15:54:57.624589 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 112/220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:57 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:57.632345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-92c9c433-6b79-4e9a-8945-96a4cbe5c5bb tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.233722 Jun 21 15:54:57.632928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 109/221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:57 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:58.086015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fed47fe6-3699-4dd5-bca8-22ad75c7a104 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:58.086626 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fed47fe6-3699-4dd5-bca8-22ad75c7a104 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:58.092763 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fed47fe6-3699-4dd5-bca8-22ad75c7a104 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:58.093201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fed47fe6-3699-4dd5-bca8-22ad75c7a104 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:58.094041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fed47fe6-3699-4dd5-bca8-22ad75c7a104 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:58.094513 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fed47fe6-3699-4dd5-bca8-22ad75c7a104 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:58.118176 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:58.118799 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:58.127809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:58.128257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:58.129032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:58.129457 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:58.300438 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fed47fe6-3699-4dd5-bca8-22ad75c7a104 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:58.304809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:58.312122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fed47fe6-3699-4dd5-bca8-22ad75c7a104 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.231222 Jun 21 15:54:58.313924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 113/222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:58 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:58.315804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:58.317317 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:58.318571 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8ce41b41-5841-4c1b-90d2-100e66de156f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.204625 Jun 21 15:54:58.319122 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 110/223] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:58 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:58.645736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-212a6bd8-34be-446b-91c9-9e5a593f84a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:58.646405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-212a6bd8-34be-446b-91c9-9e5a593f84a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:58.649896 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c6d7159c-fb85-4a2c-a4a8-fa04cc0bf8b7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:58.650539 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c6d7159c-fb85-4a2c-a4a8-fa04cc0bf8b7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:58.653175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-212a6bd8-34be-446b-91c9-9e5a593f84a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:58.653620 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-212a6bd8-34be-446b-91c9-9e5a593f84a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:58.654440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-212a6bd8-34be-446b-91c9-9e5a593f84a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:58.654861 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-212a6bd8-34be-446b-91c9-9e5a593f84a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:58.657015 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6d7159c-fb85-4a2c-a4a8-fa04cc0bf8b7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:58.657458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6d7159c-fb85-4a2c-a4a8-fa04cc0bf8b7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:58.658266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6d7159c-fb85-4a2c-a4a8-fa04cc0bf8b7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:58.658691 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6d7159c-fb85-4a2c-a4a8-fa04cc0bf8b7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:58.848206 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-212a6bd8-34be-446b-91c9-9e5a593f84a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:58.853908 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c6d7159c-fb85-4a2c-a4a8-fa04cc0bf8b7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:58.860932 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-212a6bd8-34be-446b-91c9-9e5a593f84a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.222025 Jun 21 15:54:58.861246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c6d7159c-fb85-4a2c-a4a8-fa04cc0bf8b7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.215512 Jun 21 15:54:58.861518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 114/224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:58 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:58.862291 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 111/225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:58 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:59.331748 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d3e5a631-4e64-4c4a-b804-a93d46f97ab2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:59.332334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d3e5a631-4e64-4c4a-b804-a93d46f97ab2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:59.336730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:59.337334 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:59.338898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3e5a631-4e64-4c4a-b804-a93d46f97ab2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:59.339380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3e5a631-4e64-4c4a-b804-a93d46f97ab2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:59.340153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3e5a631-4e64-4c4a-b804-a93d46f97ab2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:59.340579 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3e5a631-4e64-4c4a-b804-a93d46f97ab2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:59.343979 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:59.344456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:59.345220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:59.346156 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:59.543014 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d3e5a631-4e64-4c4a-b804-a93d46f97ab2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:59.547433 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:59.554137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d3e5a631-4e64-4c4a-b804-a93d46f97ab2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.226345 Jun 21 15:54:59.554975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 115/226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:59 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:54:59.558208 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:59.559890 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:54:59.561152 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d9ad251c-7cd2-4fd5-bcf0-054914899c43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.228445 Jun 21 15:54:59.564869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 112/227] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:54:59 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:54:59.879357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c9ad1f82-f967-47c0-96c5-a6fe13ba8ac1 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:59.879904 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d329d982-fed8-40e9-b839-d33a4130a6b5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:54:59.880093 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c9ad1f82-f967-47c0-96c5-a6fe13ba8ac1 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:59.880505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d329d982-fed8-40e9-b839-d33a4130a6b5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:54:59.886598 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c9ad1f82-f967-47c0-96c5-a6fe13ba8ac1 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:59.887044 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c9ad1f82-f967-47c0-96c5-a6fe13ba8ac1 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:59.887719 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d329d982-fed8-40e9-b839-d33a4130a6b5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:59.887831 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c9ad1f82-f967-47c0-96c5-a6fe13ba8ac1 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:59.888135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d329d982-fed8-40e9-b839-d33a4130a6b5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:59.888291 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c9ad1f82-f967-47c0-96c5-a6fe13ba8ac1 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:54:59.888898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d329d982-fed8-40e9-b839-d33a4130a6b5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:54:59.889324 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d329d982-fed8-40e9-b839-d33a4130a6b5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:00.090153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d329d982-fed8-40e9-b839-d33a4130a6b5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:00.092834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c9ad1f82-f967-47c0-96c5-a6fe13ba8ac1 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:00.098807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d329d982-fed8-40e9-b839-d33a4130a6b5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.224054 Jun 21 15:55:00.099423 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 116/228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:59 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:00.102539 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c9ad1f82-f967-47c0-96c5-a6fe13ba8ac1 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.227746 Jun 21 15:55:00.103083 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 113/229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:54:59 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:55:00.576118 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8e641ed8-cfba-44e3-bf76-99e134613f45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:00.577357 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8e641ed8-cfba-44e3-bf76-99e134613f45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:00.580715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:00.581421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:00.585473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8e641ed8-cfba-44e3-bf76-99e134613f45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:00.586027 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8e641ed8-cfba-44e3-bf76-99e134613f45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:00.587591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8e641ed8-cfba-44e3-bf76-99e134613f45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:00.588096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8e641ed8-cfba-44e3-bf76-99e134613f45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:00.589056 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:00.589509 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:00.590784 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:00.591296 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:00.830250 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:00.841986 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8e641ed8-cfba-44e3-bf76-99e134613f45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:00.853237 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:00.855091 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:00.855402 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8e641ed8-cfba-44e3-bf76-99e134613f45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.285574 Jun 21 15:55:00.857061 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 117/230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:00 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:00.857206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-323f1063-aae3-4de7-bbe8-247f7971090a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.281920 Jun 21 15:55:00.857206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 114/231] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:55:00 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:55:00.870476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-0e002650-a4c5-4e54-8987-c926f1abb5dc req-87e29b8a-5649-4c27-a8cb-357c4410207b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd1f66a-f226-49c0-8f07-54b3c9abc2c2", "name": "network-vif-plugged", "status": "completed", "tag": "e91ce2c0-3142-4f10-9149-df9295df6dc5"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:55:00.878565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0e002650-a4c5-4e54-8987-c926f1abb5dc req-87e29b8a-5649-4c27-a8cb-357c4410207b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:00.879004 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0e002650-a4c5-4e54-8987-c926f1abb5dc req-87e29b8a-5649-4c27-a8cb-357c4410207b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:00.890046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-0e002650-a4c5-4e54-8987-c926f1abb5dc req-87e29b8a-5649-4c27-a8cb-357c4410207b service nova] Creating event network-vif-plugged:e91ce2c0-3142-4f10-9149-df9295df6dc5 for instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 on hv-cinder-84067 Jun 21 15:55:00.895211 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-0e002650-a4c5-4e54-8987-c926f1abb5dc req-87e29b8a-5649-4c27-a8cb-357c4410207b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038043 Jun 21 15:55:00.895974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 118/232] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:55:01.116483 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6faac03e-2675-4d10-ba98-2d4830bbc6d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:01.117109 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6faac03e-2675-4d10-ba98-2d4830bbc6d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:01.120783 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8780b802-72d4-4e18-8212-8ae49852d7ce tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:01.121489 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8780b802-72d4-4e18-8212-8ae49852d7ce tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:01.123421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6faac03e-2675-4d10-ba98-2d4830bbc6d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:01.123857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6faac03e-2675-4d10-ba98-2d4830bbc6d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:01.124643 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6faac03e-2675-4d10-ba98-2d4830bbc6d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:01.125067 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6faac03e-2675-4d10-ba98-2d4830bbc6d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:01.128391 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8780b802-72d4-4e18-8212-8ae49852d7ce tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:01.128819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8780b802-72d4-4e18-8212-8ae49852d7ce tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:01.129569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8780b802-72d4-4e18-8212-8ae49852d7ce tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:01.130111 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8780b802-72d4-4e18-8212-8ae49852d7ce tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:01.134326 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:01.345128 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6faac03e-2675-4d10-ba98-2d4830bbc6d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:01.349332 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8780b802-72d4-4e18-8212-8ae49852d7ce tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:01.354400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6faac03e-2675-4d10-ba98-2d4830bbc6d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.241965 Jun 21 15:55:01.355255 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 115/233] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:01 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:01.358450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8780b802-72d4-4e18-8212-8ae49852d7ce tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1315 microversion: 2.1 time: 0.241420 Jun 21 15:55:01.359310 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:01 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:01.874348 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:01.875353 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e45558d2-20e2-45b9-b55d-2bc964aeffd5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:01.875736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:01.875860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e45558d2-20e2-45b9-b55d-2bc964aeffd5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:01.883684 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:01.884211 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:01.885077 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:01.885630 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:01.891188 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e45558d2-20e2-45b9-b55d-2bc964aeffd5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:01.891625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e45558d2-20e2-45b9-b55d-2bc964aeffd5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:01.892801 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e45558d2-20e2-45b9-b55d-2bc964aeffd5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:01.892941 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e45558d2-20e2-45b9-b55d-2bc964aeffd5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:02.276948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:02.280146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e45558d2-20e2-45b9-b55d-2bc964aeffd5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:02.285539 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:02.287351 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:02.288348 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e45558d2-20e2-45b9-b55d-2bc964aeffd5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.418025 Jun 21 15:55:02.288468 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f524aa5d-d07f-4732-8e46-eeb45c6a3127 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1407 microversion: 2.20 time: 0.418155 Jun 21 15:55:02.289201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 120/235] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:55:01 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:55:02.289311 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 116/236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:01 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:02.377474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0e9c32a8-6c60-4cca-adca-81648fc15965 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:02.378617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0e9c32a8-6c60-4cca-adca-81648fc15965 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:02.379613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4e70e8ef-dfb7-4ebd-81ac-0b7183b752ec tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:02.380711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4e70e8ef-dfb7-4ebd-81ac-0b7183b752ec tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:02.389491 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0e9c32a8-6c60-4cca-adca-81648fc15965 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:02.390304 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0e9c32a8-6c60-4cca-adca-81648fc15965 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:02.391115 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4e70e8ef-dfb7-4ebd-81ac-0b7183b752ec tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:02.391659 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0e9c32a8-6c60-4cca-adca-81648fc15965 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:02.391897 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4e70e8ef-dfb7-4ebd-81ac-0b7183b752ec tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:02.392361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0e9c32a8-6c60-4cca-adca-81648fc15965 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:02.393064 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4e70e8ef-dfb7-4ebd-81ac-0b7183b752ec tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:02.393817 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4e70e8ef-dfb7-4ebd-81ac-0b7183b752ec tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:02.589252 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0e9c32a8-6c60-4cca-adca-81648fc15965 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:02.593940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4e70e8ef-dfb7-4ebd-81ac-0b7183b752ec tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:02.597141 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0e9c32a8-6c60-4cca-adca-81648fc15965 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.226284 Jun 21 15:55:02.598008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 121/237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:02 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:02.606852 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4e70e8ef-dfb7-4ebd-81ac-0b7183b752ec tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1502 microversion: 2.1 time: 0.233643 Jun 21 15:55:02.607923 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 117/238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:02 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:03.307213 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:03.307930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:03.316331 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f83e18fa-69c7-4317-9e65-41568d7af19b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:03.316834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:03.317054 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:03.318332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:03.318518 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:03.318976 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f83e18fa-69c7-4317-9e65-41568d7af19b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:03.329139 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f83e18fa-69c7-4317-9e65-41568d7af19b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:03.330030 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f83e18fa-69c7-4317-9e65-41568d7af19b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:03.331362 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f83e18fa-69c7-4317-9e65-41568d7af19b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:03.331912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f83e18fa-69c7-4317-9e65-41568d7af19b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:03.550599 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:03.553979 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f83e18fa-69c7-4317-9e65-41568d7af19b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:03.560631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:03.561802 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f83e18fa-69c7-4317-9e65-41568d7af19b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1363 microversion: 2.1 time: 0.258731 Jun 21 15:55:03.571045 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 122/239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:03 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:03.571190 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:03.571294 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-36bf0d13-7901-4de6-beee-397acc3581d5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1598 microversion: 2.20 time: 0.268162 Jun 21 15:55:03.571861 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 118/240] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:55:03 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1598 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:55:03.589142 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-369412ac-9874-4a11-9401-57323c66f2e9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:03.589630 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-369412ac-9874-4a11-9401-57323c66f2e9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:03.595649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-369412ac-9874-4a11-9401-57323c66f2e9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:03.596079 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-369412ac-9874-4a11-9401-57323c66f2e9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:03.596816 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-369412ac-9874-4a11-9401-57323c66f2e9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:03.597234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-369412ac-9874-4a11-9401-57323c66f2e9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:03.614600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-30c290cd-aa99-4cfc-b153-a126a14ed371 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:03.615531 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-30c290cd-aa99-4cfc-b153-a126a14ed371 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:03.622607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30c290cd-aa99-4cfc-b153-a126a14ed371 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:03.623036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30c290cd-aa99-4cfc-b153-a126a14ed371 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:03.623817 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30c290cd-aa99-4cfc-b153-a126a14ed371 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:03.624226 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30c290cd-aa99-4cfc-b153-a126a14ed371 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:03.759795 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-369412ac-9874-4a11-9401-57323c66f2e9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.174487 Jun 21 15:55:03.760352 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 123/241] 10.222.0.52 () {60 vars in 1315 bytes} [Tue Jun 21 15:55:03 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:55:03.937637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-30c290cd-aa99-4cfc-b153-a126a14ed371 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:03.946734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-30c290cd-aa99-4cfc-b153-a126a14ed371 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.336157 Jun 21 15:55:03.949911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 119/242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:03 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:55:04.044180 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-39d52b57-5fe2-442b-a719-9e5c74b01372 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74f2133f-ce86-4377-b754-7fd037035e78"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:55:04.045156 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-39d52b57-5fe2-442b-a719-9e5c74b01372 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:04.054798 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-39d52b57-5fe2-442b-a719-9e5c74b01372 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:04.055532 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-39d52b57-5fe2-442b-a719-9e5c74b01372 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:04.056580 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-39d52b57-5fe2-442b-a719-9e5c74b01372 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:04.057600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-39d52b57-5fe2-442b-a719-9e5c74b01372 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:04.584138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bec31646-6771-4efd-be38-24b02e123923 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:04.593473 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bec31646-6771-4efd-be38-24b02e123923 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:04.603096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bec31646-6771-4efd-be38-24b02e123923 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:04.603739 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bec31646-6771-4efd-be38-24b02e123923 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:04.604980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bec31646-6771-4efd-be38-24b02e123923 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:04.605579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bec31646-6771-4efd-be38-24b02e123923 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:05.014029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-bec31646-6771-4efd-be38-24b02e123923 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:05.021686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bec31646-6771-4efd-be38-24b02e123923 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1549 microversion: 2.1 time: 0.446527 Jun 21 15:55:05.027693 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 120/243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:04 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1549 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:05.037272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-edf15823-525b-46e2-b584-cf708ead4564 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:05.037936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-edf15823-525b-46e2-b584-cf708ead4564 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:05.054288 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edf15823-525b-46e2-b584-cf708ead4564 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:05.054839 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edf15823-525b-46e2-b584-cf708ead4564 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:05.055648 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edf15823-525b-46e2-b584-cf708ead4564 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:05.059393 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edf15823-525b-46e2-b584-cf708ead4564 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:05.157464 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-39d52b57-5fe2-442b-a719-9e5c74b01372 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "POST /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.118725 Jun 21 15:55:05.159076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 124/244] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 15:55:04 2022] POST /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c/os-volume_attachments => generated 194 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:55:05.172977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f85b6f5c-4cc9-4f1e-b1de-d023d7ef1c14 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:05.182002 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f85b6f5c-4cc9-4f1e-b1de-d023d7ef1c14 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:05.201435 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f85b6f5c-4cc9-4f1e-b1de-d023d7ef1c14 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:05.203652 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f85b6f5c-4cc9-4f1e-b1de-d023d7ef1c14 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:05.204578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f85b6f5c-4cc9-4f1e-b1de-d023d7ef1c14 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:05.206348 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f85b6f5c-4cc9-4f1e-b1de-d023d7ef1c14 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:05.593566 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f85b6f5c-4cc9-4f1e-b1de-d023d7ef1c14 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.432877 Jun 21 15:55:05.594482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 125/245] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jun 21 15:55:05 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/os-interface => generated 285 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:55:05.706632 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-edf15823-525b-46e2-b584-cf708ead4564 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:05.731395 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-edf15823-525b-46e2-b584-cf708ead4564 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1366 microversion: 2.1 time: 0.702269 Jun 21 15:55:05.735436 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 121/246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:05 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:06.681302 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-d4f45a76-74cb-4cb2-9602-b3a1b7ca4dee req-961579f8-4cc0-46a5-96e7-b8aad8352c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899aef0a-2cf7-47b2-9b08-0068bde58dae", "tag": "6288bac4-2f2c-42ad-9eca-74ece6209900"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:55:06.729959 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-d4f45a76-74cb-4cb2-9602-b3a1b7ca4dee req-961579f8-4cc0-46a5-96e7-b8aad8352c27 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:06.730751 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-d4f45a76-74cb-4cb2-9602-b3a1b7ca4dee req-961579f8-4cc0-46a5-96e7-b8aad8352c27 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:06.750814 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ba735204-6b93-4a74-a45a-e3e927700dc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:06.751420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ba735204-6b93-4a74-a45a-e3e927700dc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:06.762396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ba735204-6b93-4a74-a45a-e3e927700dc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:06.765756 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ba735204-6b93-4a74-a45a-e3e927700dc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:06.766744 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ba735204-6b93-4a74-a45a-e3e927700dc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:06.766975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-d4f45a76-74cb-4cb2-9602-b3a1b7ca4dee req-961579f8-4cc0-46a5-96e7-b8aad8352c27 service nova] Creating event network-changed:6288bac4-2f2c-42ad-9eca-74ece6209900 for instance 899aef0a-2cf7-47b2-9b08-0068bde58dae on hv-cinder-84067 Jun 21 15:55:06.767504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ba735204-6b93-4a74-a45a-e3e927700dc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:06.781136 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-d4f45a76-74cb-4cb2-9602-b3a1b7ca4dee req-961579f8-4cc0-46a5-96e7-b8aad8352c27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116824 Jun 21 15:55:06.784448 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 126/247] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:55:07.044446 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ba735204-6b93-4a74-a45a-e3e927700dc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:07.056274 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ba735204-6b93-4a74-a45a-e3e927700dc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1556 microversion: 2.1 time: 0.310171 Jun 21 15:55:07.057537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 122/248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:06 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1556 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:07.079976 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8aa0d2ee-05a3-4da1-b8ca-857a06a18465 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:07.081101 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8aa0d2ee-05a3-4da1-b8ca-857a06a18465 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:07.119314 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8aa0d2ee-05a3-4da1-b8ca-857a06a18465 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:07.119897 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8aa0d2ee-05a3-4da1-b8ca-857a06a18465 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:07.122331 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8aa0d2ee-05a3-4da1-b8ca-857a06a18465 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:07.122784 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8aa0d2ee-05a3-4da1-b8ca-857a06a18465 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:07.287322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8aa0d2ee-05a3-4da1-b8ca-857a06a18465 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207842 Jun 21 15:55:07.288573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 127/249] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jun 21 15:55:07 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:55:08.492553 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-4c2b8407-91f1-4819-aa21-5ea7ad2a6f6e req-b66e383c-b977-4f78-9b31-643b24aa87c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f494bc-2b5c-48f9-9842-5982a0d81192", "tag": "c891b3c8-5701-448e-86d1-f82bb6aa0a97"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:55:08.520760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-4c2b8407-91f1-4819-aa21-5ea7ad2a6f6e req-b66e383c-b977-4f78-9b31-643b24aa87c7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:08.522889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-4c2b8407-91f1-4819-aa21-5ea7ad2a6f6e req-b66e383c-b977-4f78-9b31-643b24aa87c7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:08.535251 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:08.549708 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-4c2b8407-91f1-4819-aa21-5ea7ad2a6f6e req-b66e383c-b977-4f78-9b31-643b24aa87c7 service nova] Creating event network-changed:c891b3c8-5701-448e-86d1-f82bb6aa0a97 for instance c6f494bc-2b5c-48f9-9842-5982a0d81192 on hv-cinder-84067 Jun 21 15:55:08.570759 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-4c2b8407-91f1-4819-aa21-5ea7ad2a6f6e req-b66e383c-b977-4f78-9b31-643b24aa87c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080799 Jun 21 15:55:08.571405 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 123/250] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:55:09.100100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-bc9fef59-9066-45fd-aad9-9f1c697a97ef req-64b2be80-4fed-416b-bfc8-67d7f8e3564f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd1f66a-f226-49c0-8f07-54b3c9abc2c2", "tag": "e91ce2c0-3142-4f10-9149-df9295df6dc5"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:55:09.122644 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-bc9fef59-9066-45fd-aad9-9f1c697a97ef req-64b2be80-4fed-416b-bfc8-67d7f8e3564f service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:09.123147 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-bc9fef59-9066-45fd-aad9-9f1c697a97ef req-64b2be80-4fed-416b-bfc8-67d7f8e3564f service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:09.145852 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-bc9fef59-9066-45fd-aad9-9f1c697a97ef req-64b2be80-4fed-416b-bfc8-67d7f8e3564f service nova] Creating event network-changed:e91ce2c0-3142-4f10-9149-df9295df6dc5 for instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 on hv-cinder-84067 Jun 21 15:55:09.161221 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-bc9fef59-9066-45fd-aad9-9f1c697a97ef req-64b2be80-4fed-416b-bfc8-67d7f8e3564f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067129 Jun 21 15:55:09.164575 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 128/251] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:55:14.345485 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bd80d7e5-44d4-4c9f-a163-c21388366742 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:14.346187 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bd80d7e5-44d4-4c9f-a163-c21388366742 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:14.354333 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bd80d7e5-44d4-4c9f-a163-c21388366742 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:14.354792 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bd80d7e5-44d4-4c9f-a163-c21388366742 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:14.355567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bd80d7e5-44d4-4c9f-a163-c21388366742 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:14.355982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bd80d7e5-44d4-4c9f-a163-c21388366742 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:14.383723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bd80d7e5-44d4-4c9f-a163-c21388366742 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 15:55:14.531955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bd80d7e5-44d4-4c9f-a163-c21388366742 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 204 len: 0 microversion: 2.1 time: 0.193162 Jun 21 15:55:14.532541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 124/252] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 15:55:14 2022] DELETE /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 15:55:14.541734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d9cf98f5-a80a-4377-bfae-c86235446c84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:14.542463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d9cf98f5-a80a-4377-bfae-c86235446c84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:14.545372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=92 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:14.552521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d9cf98f5-a80a-4377-bfae-c86235446c84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:14.552991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d9cf98f5-a80a-4377-bfae-c86235446c84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:14.553806 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d9cf98f5-a80a-4377-bfae-c86235446c84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:14.554220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d9cf98f5-a80a-4377-bfae-c86235446c84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:14.711729 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d9cf98f5-a80a-4377-bfae-c86235446c84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:14.720083 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d9cf98f5-a80a-4377-bfae-c86235446c84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.182838 Jun 21 15:55:14.720668 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 129/253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:14 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:15.738670 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d563fffc-d633-4359-9683-e152a3a7f98e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:15.739448 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d563fffc-d633-4359-9683-e152a3a7f98e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:15.746369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d563fffc-d633-4359-9683-e152a3a7f98e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:15.746818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d563fffc-d633-4359-9683-e152a3a7f98e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:15.747580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d563fffc-d633-4359-9683-e152a3a7f98e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:15.748005 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d563fffc-d633-4359-9683-e152a3a7f98e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:15.903794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d563fffc-d633-4359-9683-e152a3a7f98e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:15.912503 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d563fffc-d633-4359-9683-e152a3a7f98e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.178239 Jun 21 15:55:15.913099 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 125/254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:15 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:16.930137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-72111d9e-93f3-4d8c-bb56-a3a22a18979e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:16.930752 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-72111d9e-93f3-4d8c-bb56-a3a22a18979e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:16.937754 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-72111d9e-93f3-4d8c-bb56-a3a22a18979e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:16.938241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-72111d9e-93f3-4d8c-bb56-a3a22a18979e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:16.938978 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-72111d9e-93f3-4d8c-bb56-a3a22a18979e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:16.939434 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-72111d9e-93f3-4d8c-bb56-a3a22a18979e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:17.088152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-72111d9e-93f3-4d8c-bb56-a3a22a18979e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:17.096962 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-72111d9e-93f3-4d8c-bb56-a3a22a18979e tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.171010 Jun 21 15:55:17.097528 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 130/255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:16 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:18.117118 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ecdb3dbe-52ec-43b7-9a81-33afbc4f3546 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:18.117841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ecdb3dbe-52ec-43b7-9a81-33afbc4f3546 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:18.120137 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:18.125980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ecdb3dbe-52ec-43b7-9a81-33afbc4f3546 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:18.126451 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ecdb3dbe-52ec-43b7-9a81-33afbc4f3546 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:18.127224 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ecdb3dbe-52ec-43b7-9a81-33afbc4f3546 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:18.127694 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ecdb3dbe-52ec-43b7-9a81-33afbc4f3546 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:18.274344 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ecdb3dbe-52ec-43b7-9a81-33afbc4f3546 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:18.282611 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ecdb3dbe-52ec-43b7-9a81-33afbc4f3546 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.171359 Jun 21 15:55:18.283194 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 126/256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:18 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:19.300217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-98568b45-3c94-4938-bd72-c27504c97911 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:19.300848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-98568b45-3c94-4938-bd72-c27504c97911 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:19.308361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98568b45-3c94-4938-bd72-c27504c97911 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:19.308804 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98568b45-3c94-4938-bd72-c27504c97911 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:19.309544 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98568b45-3c94-4938-bd72-c27504c97911 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:19.310019 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98568b45-3c94-4938-bd72-c27504c97911 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:19.454689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-98568b45-3c94-4938-bd72-c27504c97911 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:19.463124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-98568b45-3c94-4938-bd72-c27504c97911 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.166839 Jun 21 15:55:19.463739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 131/257] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:19 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:20.484684 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e6d39b8c-1a35-4b4f-8e91-e0ae8d116e84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:20.485372 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e6d39b8c-1a35-4b4f-8e91-e0ae8d116e84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:20.493430 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6d39b8c-1a35-4b4f-8e91-e0ae8d116e84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:20.493995 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6d39b8c-1a35-4b4f-8e91-e0ae8d116e84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:20.494810 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6d39b8c-1a35-4b4f-8e91-e0ae8d116e84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:20.495332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6d39b8c-1a35-4b4f-8e91-e0ae8d116e84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:20.649377 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e6d39b8c-1a35-4b4f-8e91-e0ae8d116e84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:20.658092 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e6d39b8c-1a35-4b4f-8e91-e0ae8d116e84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.177807 Jun 21 15:55:20.658668 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 127/258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:20 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:21.677741 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-16a86881-e6fc-4135-9465-6476e6185b20 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:21.678486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-16a86881-e6fc-4135-9465-6476e6185b20 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:21.687332 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-16a86881-e6fc-4135-9465-6476e6185b20 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:21.687888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-16a86881-e6fc-4135-9465-6476e6185b20 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:21.688889 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-16a86881-e6fc-4135-9465-6476e6185b20 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:21.689324 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-16a86881-e6fc-4135-9465-6476e6185b20 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:21.837807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-16a86881-e6fc-4135-9465-6476e6185b20 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:21.846787 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-16a86881-e6fc-4135-9465-6476e6185b20 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.173681 Jun 21 15:55:21.847365 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 132/259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:21 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:22.866859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fe9dfd0a-20cf-4632-9340-82c447f564e7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:22.867991 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fe9dfd0a-20cf-4632-9340-82c447f564e7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:22.875054 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fe9dfd0a-20cf-4632-9340-82c447f564e7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:22.875486 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fe9dfd0a-20cf-4632-9340-82c447f564e7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:22.876222 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fe9dfd0a-20cf-4632-9340-82c447f564e7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:22.876645 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fe9dfd0a-20cf-4632-9340-82c447f564e7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:23.022761 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fe9dfd0a-20cf-4632-9340-82c447f564e7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:23.031660 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fe9dfd0a-20cf-4632-9340-82c447f564e7 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.168675 Jun 21 15:55:23.032586 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 128/260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:22 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:24.052185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ba539440-2b90-431a-9ac4-5c4b6335e0c5 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:24.052914 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ba539440-2b90-431a-9ac4-5c4b6335e0c5 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:24.063514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ba539440-2b90-431a-9ac4-5c4b6335e0c5 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:24.063514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ba539440-2b90-431a-9ac4-5c4b6335e0c5 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:24.064081 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ba539440-2b90-431a-9ac4-5c4b6335e0c5 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:24.064600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ba539440-2b90-431a-9ac4-5c4b6335e0c5 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:24.228809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ba539440-2b90-431a-9ac4-5c4b6335e0c5 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:24.238180 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ba539440-2b90-431a-9ac4-5c4b6335e0c5 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.192437 Jun 21 15:55:24.238783 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 133/261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:24 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:25.256788 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8765146d-f3e1-42a0-94d6-663a04eb9a08 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:25.257378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8765146d-f3e1-42a0-94d6-663a04eb9a08 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:25.265728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8765146d-f3e1-42a0-94d6-663a04eb9a08 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:25.266289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8765146d-f3e1-42a0-94d6-663a04eb9a08 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:25.267047 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8765146d-f3e1-42a0-94d6-663a04eb9a08 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:25.267465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8765146d-f3e1-42a0-94d6-663a04eb9a08 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:25.411275 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8765146d-f3e1-42a0-94d6-663a04eb9a08 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:25.420789 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8765146d-f3e1-42a0-94d6-663a04eb9a08 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.167890 Jun 21 15:55:25.421356 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 129/262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:25 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:26.442829 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6745d6fe-1f50-44ca-ae4c-951149d2d144 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:26.443823 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6745d6fe-1f50-44ca-ae4c-951149d2d144 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:26.452185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6745d6fe-1f50-44ca-ae4c-951149d2d144 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:26.452626 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6745d6fe-1f50-44ca-ae4c-951149d2d144 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:26.453385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6745d6fe-1f50-44ca-ae4c-951149d2d144 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:26.453840 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6745d6fe-1f50-44ca-ae4c-951149d2d144 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:26.603087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6745d6fe-1f50-44ca-ae4c-951149d2d144 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:26.617187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6745d6fe-1f50-44ca-ae4c-951149d2d144 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.179745 Jun 21 15:55:26.618100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 134/263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:26 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:27.636332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b3d8eb5b-6f17-4d90-90a8-e8516ebba16c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:27.636939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b3d8eb5b-6f17-4d90-90a8-e8516ebba16c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:27.643705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b3d8eb5b-6f17-4d90-90a8-e8516ebba16c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:27.644145 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b3d8eb5b-6f17-4d90-90a8-e8516ebba16c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:27.644936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b3d8eb5b-6f17-4d90-90a8-e8516ebba16c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:27.645358 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b3d8eb5b-6f17-4d90-90a8-e8516ebba16c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:27.779877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b3d8eb5b-6f17-4d90-90a8-e8516ebba16c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:27.787874 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b3d8eb5b-6f17-4d90-90a8-e8516ebba16c tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.156211 Jun 21 15:55:27.788571 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 130/264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:27 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:28.805320 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3d1c6889-3b88-487f-8b9c-08dbe34f4a84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:28.806128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3d1c6889-3b88-487f-8b9c-08dbe34f4a84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:28.813947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3d1c6889-3b88-487f-8b9c-08dbe34f4a84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:28.814392 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3d1c6889-3b88-487f-8b9c-08dbe34f4a84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:28.815157 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3d1c6889-3b88-487f-8b9c-08dbe34f4a84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:28.815590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3d1c6889-3b88-487f-8b9c-08dbe34f4a84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:28.954159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3d1c6889-3b88-487f-8b9c-08dbe34f4a84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:28.962882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3d1c6889-3b88-487f-8b9c-08dbe34f4a84 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.162081 Jun 21 15:55:28.963703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 135/265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:28 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:29.981429 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-95287ba4-10c9-40f3-9621-559d2cb43688 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:29.982047 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-95287ba4-10c9-40f3-9621-559d2cb43688 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:29.988785 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-95287ba4-10c9-40f3-9621-559d2cb43688 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:29.989222 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-95287ba4-10c9-40f3-9621-559d2cb43688 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:29.990074 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-95287ba4-10c9-40f3-9621-559d2cb43688 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:29.990497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-95287ba4-10c9-40f3-9621-559d2cb43688 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:30.149016 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-95287ba4-10c9-40f3-9621-559d2cb43688 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:30.157854 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-95287ba4-10c9-40f3-9621-559d2cb43688 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.180966 Jun 21 15:55:30.158477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 131/266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:29 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:31.175665 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-35342dae-a2f2-4dab-a882-e67aa89e3292 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:31.176200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-35342dae-a2f2-4dab-a882-e67aa89e3292 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:31.183412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35342dae-a2f2-4dab-a882-e67aa89e3292 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:31.183855 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35342dae-a2f2-4dab-a882-e67aa89e3292 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:31.184614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35342dae-a2f2-4dab-a882-e67aa89e3292 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:31.185034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35342dae-a2f2-4dab-a882-e67aa89e3292 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:31.187648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:31.322963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-35342dae-a2f2-4dab-a882-e67aa89e3292 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:31.331444 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-35342dae-a2f2-4dab-a882-e67aa89e3292 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.159831 Jun 21 15:55:31.332010 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 136/267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:31 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:32.354667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a4bd9527-86c3-4a57-aeff-e90a954674be tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:32.355288 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a4bd9527-86c3-4a57-aeff-e90a954674be tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:32.364792 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a4bd9527-86c3-4a57-aeff-e90a954674be tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:32.365252 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a4bd9527-86c3-4a57-aeff-e90a954674be tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:32.366079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a4bd9527-86c3-4a57-aeff-e90a954674be tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:32.366487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a4bd9527-86c3-4a57-aeff-e90a954674be tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:32.506092 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a4bd9527-86c3-4a57-aeff-e90a954674be tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:32.515133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a4bd9527-86c3-4a57-aeff-e90a954674be tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.167065 Jun 21 15:55:32.515690 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 132/268] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:32 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:33.532741 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-80ff5d09-d233-45e4-8151-87b3308cf203 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:33.533376 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-80ff5d09-d233-45e4-8151-87b3308cf203 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:33.540319 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-80ff5d09-d233-45e4-8151-87b3308cf203 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:33.540752 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-80ff5d09-d233-45e4-8151-87b3308cf203 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:33.542364 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-80ff5d09-d233-45e4-8151-87b3308cf203 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:33.542796 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-80ff5d09-d233-45e4-8151-87b3308cf203 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:33.682655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-80ff5d09-d233-45e4-8151-87b3308cf203 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:33.690838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-80ff5d09-d233-45e4-8151-87b3308cf203 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.162209 Jun 21 15:55:33.691410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 137/269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:33 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:34.708961 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-890d260b-e633-4a8e-a4ce-ee9237f9b84a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:34.709613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-890d260b-e633-4a8e-a4ce-ee9237f9b84a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:34.716363 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-890d260b-e633-4a8e-a4ce-ee9237f9b84a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:34.716802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-890d260b-e633-4a8e-a4ce-ee9237f9b84a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:34.717545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-890d260b-e633-4a8e-a4ce-ee9237f9b84a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:34.718001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-890d260b-e633-4a8e-a4ce-ee9237f9b84a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:34.856861 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-890d260b-e633-4a8e-a4ce-ee9237f9b84a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:34.866937 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-890d260b-e633-4a8e-a4ce-ee9237f9b84a tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.161653 Jun 21 15:55:34.867855 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 133/270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:34 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:35.884991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d02e54bf-e15c-47fb-a1ee-e5e4933d86c4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:35.885719 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d02e54bf-e15c-47fb-a1ee-e5e4933d86c4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:35.892449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d02e54bf-e15c-47fb-a1ee-e5e4933d86c4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:35.892893 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d02e54bf-e15c-47fb-a1ee-e5e4933d86c4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:35.893654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d02e54bf-e15c-47fb-a1ee-e5e4933d86c4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:35.894129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d02e54bf-e15c-47fb-a1ee-e5e4933d86c4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:36.029503 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d02e54bf-e15c-47fb-a1ee-e5e4933d86c4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:36.037856 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d02e54bf-e15c-47fb-a1ee-e5e4933d86c4 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.156864 Jun 21 15:55:36.038433 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 138/271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:35 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:37.055502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6d2dac15-22e0-4e45-9491-eaeab288f780 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:37.056036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6d2dac15-22e0-4e45-9491-eaeab288f780 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:37.063101 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6d2dac15-22e0-4e45-9491-eaeab288f780 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:37.063531 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6d2dac15-22e0-4e45-9491-eaeab288f780 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:37.064287 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6d2dac15-22e0-4e45-9491-eaeab288f780 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:37.064712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6d2dac15-22e0-4e45-9491-eaeab288f780 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:37.236637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6d2dac15-22e0-4e45-9491-eaeab288f780 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:37.245401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6d2dac15-22e0-4e45-9491-eaeab288f780 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1554 microversion: 2.1 time: 0.193985 Jun 21 15:55:37.246684 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 134/272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:37 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:37.613313 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-5a7d7811-57eb-43bc-830b-0c63c55c9a56 req-4edbbbc7-6359-4680-b51f-bb6143bb3f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec4529a-7353-4e5e-9445-92924998e57c", "name": "network-vif-deleted", "tag": "d17f1129-12c2-4041-a70f-9aac14587914"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:55:37.623244 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-5a7d7811-57eb-43bc-830b-0c63c55c9a56 req-4edbbbc7-6359-4680-b51f-bb6143bb3f7e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:37.623776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-5a7d7811-57eb-43bc-830b-0c63c55c9a56 req-4edbbbc7-6359-4680-b51f-bb6143bb3f7e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:37.636000 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-5a7d7811-57eb-43bc-830b-0c63c55c9a56 req-4edbbbc7-6359-4680-b51f-bb6143bb3f7e service nova] Creating event network-vif-deleted:d17f1129-12c2-4041-a70f-9aac14587914 for instance aec4529a-7353-4e5e-9445-92924998e57c on hv-cinder-84067 Jun 21 15:55:37.641688 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-5a7d7811-57eb-43bc-830b-0c63c55c9a56 req-4edbbbc7-6359-4680-b51f-bb6143bb3f7e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032595 Jun 21 15:55:37.642383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 139/273] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:55:38.264386 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e50a47c1-b9be-42ce-98b3-4b2eaf4d1a55 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:38.265114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e50a47c1-b9be-42ce-98b3-4b2eaf4d1a55 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:38.271408 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e50a47c1-b9be-42ce-98b3-4b2eaf4d1a55 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:38.271869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e50a47c1-b9be-42ce-98b3-4b2eaf4d1a55 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:38.272703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e50a47c1-b9be-42ce-98b3-4b2eaf4d1a55 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:38.273030 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e50a47c1-b9be-42ce-98b3-4b2eaf4d1a55 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:38.347957 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e50a47c1-b9be-42ce-98b3-4b2eaf4d1a55 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:38.357184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e50a47c1-b9be-42ce-98b3-4b2eaf4d1a55 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1512 microversion: 2.1 time: 0.096792 Jun 21 15:55:38.357482 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 135/274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:38 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:39.375567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-346c34ca-8d26-4a4a-ad94-fc04f9fee9df tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:39.376181 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-346c34ca-8d26-4a4a-ad94-fc04f9fee9df tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:39.382824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-346c34ca-8d26-4a4a-ad94-fc04f9fee9df tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:39.383273 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-346c34ca-8d26-4a4a-ad94-fc04f9fee9df tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:39.384034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-346c34ca-8d26-4a4a-ad94-fc04f9fee9df tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:39.384609 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-346c34ca-8d26-4a4a-ad94-fc04f9fee9df tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:39.452748 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-346c34ca-8d26-4a4a-ad94-fc04f9fee9df tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:39.464140 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-346c34ca-8d26-4a4a-ad94-fc04f9fee9df tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1512 microversion: 2.1 time: 0.093248 Jun 21 15:55:39.464747 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 140/275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:39 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:55:40.483008 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8c02fb3a-5f11-4a87-918a-1e0a146d0d6f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:40.483792 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8c02fb3a-5f11-4a87-918a-1e0a146d0d6f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:40.494585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8c02fb3a-5f11-4a87-918a-1e0a146d0d6f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:40.494585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8c02fb3a-5f11-4a87-918a-1e0a146d0d6f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:40.494585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8c02fb3a-5f11-4a87-918a-1e0a146d0d6f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:40.494585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8c02fb3a-5f11-4a87-918a-1e0a146d0d6f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:40.497381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:40.578963 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8c02fb3a-5f11-4a87-918a-1e0a146d0d6f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:40.589409 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8c02fb3a-5f11-4a87-918a-1e0a146d0d6f tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1346 microversion: 2.1 time: 0.111304 Jun 21 15:55:40.590020 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 136/276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:40 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:41.608743 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3ebbb9f7-4f1a-4eaa-95b8-75d98be32701 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:41.609424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3ebbb9f7-4f1a-4eaa-95b8-75d98be32701 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:41.619194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3ebbb9f7-4f1a-4eaa-95b8-75d98be32701 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:41.619868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3ebbb9f7-4f1a-4eaa-95b8-75d98be32701 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:41.621108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3ebbb9f7-4f1a-4eaa-95b8-75d98be32701 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:41.621819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3ebbb9f7-4f1a-4eaa-95b8-75d98be32701 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:41.694425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3ebbb9f7-4f1a-4eaa-95b8-75d98be32701 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:41.704352 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3ebbb9f7-4f1a-4eaa-95b8-75d98be32701 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1346 microversion: 2.1 time: 0.099647 Jun 21 15:55:41.704906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 141/277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:41 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:55:42.726999 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-157e35b9-2be3-4ab9-8442-cd194b32619b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:42.727567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-157e35b9-2be3-4ab9-8442-cd194b32619b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:42.733726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-157e35b9-2be3-4ab9-8442-cd194b32619b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:42.736493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-157e35b9-2be3-4ab9-8442-cd194b32619b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:42.736493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-157e35b9-2be3-4ab9-8442-cd194b32619b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:42.736493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-157e35b9-2be3-4ab9-8442-cd194b32619b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:42.802203 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-157e35b9-2be3-4ab9-8442-cd194b32619b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:42.811195 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-157e35b9-2be3-4ab9-8442-cd194b32619b tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1346 microversion: 2.1 time: 0.088432 Jun 21 15:55:42.811780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 137/278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:42 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:43.830447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3011ef8e-3dce-4813-8c71-608268adcd47 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:43.831082 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3011ef8e-3dce-4813-8c71-608268adcd47 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:43.838541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3011ef8e-3dce-4813-8c71-608268adcd47 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:43.839033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3011ef8e-3dce-4813-8c71-608268adcd47 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:43.839800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3011ef8e-3dce-4813-8c71-608268adcd47 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:43.840230 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3011ef8e-3dce-4813-8c71-608268adcd47 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:43.909382 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3011ef8e-3dce-4813-8c71-608268adcd47 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:43.920585 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3011ef8e-3dce-4813-8c71-608268adcd47 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1346 microversion: 2.1 time: 0.095608 Jun 21 15:55:43.921172 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 142/279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:43 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:44.938625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:44.939489 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:44.947698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:44.948349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:44.949161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:44.949579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:44.983465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:44.983909 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:44.984391 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lazy-loading 'fault' on Instance uuid aec4529a-7353-4e5e-9445-92924998e57c {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 15:55:45.031732 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23031b94dc7f47bf8272b266cbe18a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707b41a2e0ce4a8abc4e26c88ce94267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:45.041234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f3af386b-0b27-4f3d-b8ab-9541a9f57807 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 200 len: 1351 microversion: 2.1 time: 0.107338 Jun 21 15:55:45.041751 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 138/280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:44 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:46.059234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:46.059815 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:46.062391 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=28 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:46.068097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:46.068534 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:46.069579 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:46.070030 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:46.084038 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] HTTP exception thrown: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Request method failure captured: Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c HTTP/1.1 Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemOSaoWg4_ujsv77BfA8AK1KVTF0vCYWKz-mj-QpzklQInaBlAOe2KdkAquJd0rGSPyKaTxhlGDOmq-7zjCaTkHhgM2IBh1RkHxO26oEmCxCWKO98iANvZHoBdU6LP3JNyGTUZBPM4o69EqS84mfp2lcT5s0bREjorougn4eJWXb30 Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 707b41a2e0ce4a8abc4e26c88ce94267 Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 15:55:46.089671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_707b41a2e0ce4a8abc4e26c88ce94267", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 707b41a2e0ce4a8abc4e26c88ce94267 Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-DeleteServersTestJSON-360675543-project Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 23031b94dc7f47bf8272b266cbe18a8c Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-DeleteServersTestJSON-360675543-project Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.091124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'aec4529a-7353-4e5e-9445-92924998e57c'} Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:55:46.091968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.093379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.094639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Returning 404 to user: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:55:46.094639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cb2ac0df-7304-469e-82e4-b3fa7c7103c0 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 404 len: 111 microversion: 2.1 time: 0.036521 Jun 21 15:55:46.094639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 143/281] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:46 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:55:46.201176 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:46.202257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:46.209121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:46.209557 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:46.210342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:46.210764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:46.223968 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] HTTP exception thrown: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Request method failure captured: Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c/os-volume_attachments HTTP/1.1 Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemOSaoWg4_ujsv77BfA8AK1KVTF0vCYWKz-mj-QpzklQInaBlAOe2KdkAquJd0rGSPyKaTxhlGDOmq-7zjCaTkHhgM2IBh1RkHxO26oEmCxCWKO98iANvZHoBdU6LP3JNyGTUZBPM4o69EqS84mfp2lcT5s0bREjorougn4eJWXb30 Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 707b41a2e0ce4a8abc4e26c88ce94267 Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:55:46.228676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_707b41a2e0ce4a8abc4e26c88ce94267", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 707b41a2e0ce4a8abc4e26c88ce94267 Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-DeleteServersTestJSON-360675543-project Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 23031b94dc7f47bf8272b266cbe18a8c Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-DeleteServersTestJSON-360675543-project Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.230397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'server_id': 'aec4529a-7353-4e5e-9445-92924998e57c'} Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:55:46.231125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:46.232399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:46.233696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Returning 404 to user: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:55:46.233696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-149ba5d0-318b-4e6f-9d92-2c5ca8ef23cd tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033783 Jun 21 15:55:46.233696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 139/282] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 15:55:46 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:55:47.441205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:47.441720 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:47.452286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:47.452782 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:47.453620 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:47.454259 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:47.467776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] HTTP exception thrown: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Request method failure captured: Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c HTTP/1.1 Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemOSaoWg4_ujsv77BfA8AK1KVTF0vCYWKz-mj-QpzklQInaBlAOe2KdkAquJd0rGSPyKaTxhlGDOmq-7zjCaTkHhgM2IBh1RkHxO26oEmCxCWKO98iANvZHoBdU6LP3JNyGTUZBPM4o69EqS84mfp2lcT5s0bREjorougn4eJWXb30 Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 707b41a2e0ce4a8abc4e26c88ce94267 Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 15:55:47.469361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_707b41a2e0ce4a8abc4e26c88ce94267", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 707b41a2e0ce4a8abc4e26c88ce94267 Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-DeleteServersTestJSON-360675543-project Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 23031b94dc7f47bf8272b266cbe18a8c Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-DeleteServersTestJSON-360675543-project Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.471208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'aec4529a-7353-4e5e-9445-92924998e57c'} Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:55:47.472683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.474007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.475828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Returning 404 to user: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:55:47.475828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b7057a3c-dd5e-4307-8818-a4a9c2420ef2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 404 len: 111 microversion: 2.1 time: 0.033664 Jun 21 15:55:47.475828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 144/283] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 15:55:47 2022] DELETE /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:55:47.481221 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:47.481871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] [instance: aec4529a-7353-4e5e-9445-92924998e57c] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:47.488113 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:47.488549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:47.489292 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:47.489733 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:47.503717 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] HTTP exception thrown: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Request method failure captured: Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c HTTP/1.1 Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemOSaoWg4_ujsv77BfA8AK1KVTF0vCYWKz-mj-QpzklQInaBlAOe2KdkAquJd0rGSPyKaTxhlGDOmq-7zjCaTkHhgM2IBh1RkHxO26oEmCxCWKO98iANvZHoBdU6LP3JNyGTUZBPM4o69EqS84mfp2lcT5s0bREjorougn4eJWXb30 Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 707b41a2e0ce4a8abc4e26c88ce94267 Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:55:47.505860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/707b41a2e0ce4a8abc4e26c88ce94267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_707b41a2e0ce4a8abc4e26c88ce94267", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 707b41a2e0ce4a8abc4e26c88ce94267 Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-DeleteServersTestJSON-360675543 Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-DeleteServersTestJSON-360675543-project Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 23031b94dc7f47bf8272b266cbe18a8c Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-DeleteServersTestJSON-360675543-project Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.506972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'aec4529a-7353-4e5e-9445-92924998e57c'} Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:55:47.507590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. Jun 21 15:55:47.509432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:55:47.510643 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] Returning 404 to user: Instance aec4529a-7353-4e5e-9445-92924998e57c could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:55:47.510643 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3ffffb83-f8cc-402b-be85-80c9a52982b2 tempest-DeleteServersTestJSON-360675543 tempest-DeleteServersTestJSON-360675543-project] 10.222.0.52 "GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c" status: 404 len: 111 microversion: 2.1 time: 0.030255 Jun 21 15:55:47.510643 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 140/284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:47 2022] GET /compute/v2.1/servers/aec4529a-7353-4e5e-9445-92924998e57c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:55:56.644590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1258580660", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:55:56.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] validate_networks() for [('5087213d-7a21-43e5-852a-25ad34dd2ccf', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:55:57.139854 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:55:57.140299 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:55:57.140735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:55:57.141128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:55:57.141541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:55:57.152581 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:57.153321 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:57.154395 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:57.154846 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:57.177363 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Getting quotas for project 8818885318b54ef6858e754d2bc4587c. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:55:57.184404 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Getting quotas for user 01571ac0b01845f78192269cacb23644 and project 8818885318b54ef6858e754d2bc4587c. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:55:57.200372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:55:57.202919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:55:57.258171 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-22f4096e-5489-4532-b191-1e4a6cb69066 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.785741 Jun 21 15:55:57.259288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 145/285] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:55:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:55:57.269191 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4383fa2d-5f52-47dd-8076-90e3a8560659 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:57.269718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4383fa2d-5f52-47dd-8076-90e3a8560659 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:57.271865 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=32 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:57.335106 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4383fa2d-5f52-47dd-8076-90e3a8560659 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:57.344612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4383fa2d-5f52-47dd-8076-90e3a8560659 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1222 microversion: 2.1 time: 0.079321 Jun 21 15:55:57.345453 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 141/286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:57 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:55:57.408336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-681374938", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:55:57.483991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] validate_networks() for [('5087213d-7a21-43e5-852a-25ad34dd2ccf', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:55:57.990331 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:55:57.992395 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:55:57.992927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:55:57.993576 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:55:57.994216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:55:58.008895 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:58.009922 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:58.010977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:58.011639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:58.047777 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Getting quotas for project 8818885318b54ef6858e754d2bc4587c. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:55:58.058018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Getting quotas for user 01571ac0b01845f78192269cacb23644 and project 8818885318b54ef6858e754d2bc4587c. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:55:58.071636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:55:58.078669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:55:58.153613 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cd77c253-1a85-4731-bcbd-295d332c3138 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.751118 Jun 21 15:55:58.155539 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 146/287] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:55:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:55:58.166771 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5ff4c631-8a34-4fe3-8359-c2d8a6665fc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:58.167744 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5ff4c631-8a34-4fe3-8359-c2d8a6665fc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:58.177342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=23 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:55:58.281458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5ff4c631-8a34-4fe3-8359-c2d8a6665fc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:58.292830 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5ff4c631-8a34-4fe3-8359-c2d8a6665fc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1221 microversion: 2.1 time: 0.131210 Jun 21 15:55:58.294340 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 142/288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:58 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:55:59.316559 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8c0d407d-dc9e-4f6a-b6fd-74b727cedfab tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:55:59.317710 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8c0d407d-dc9e-4f6a-b6fd-74b727cedfab tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:55:59.329269 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c0d407d-dc9e-4f6a-b6fd-74b727cedfab tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:59.330332 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c0d407d-dc9e-4f6a-b6fd-74b727cedfab tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:59.331704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c0d407d-dc9e-4f6a-b6fd-74b727cedfab tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:55:59.333366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c0d407d-dc9e-4f6a-b6fd-74b727cedfab tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:55:59.410945 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8c0d407d-dc9e-4f6a-b6fd-74b727cedfab tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:55:59.418456 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8c0d407d-dc9e-4f6a-b6fd-74b727cedfab tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1273 microversion: 2.1 time: 0.111113 Jun 21 15:55:59.419032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 147/289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:55:59 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:00.438955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a1057f63-c7ba-444a-ad85-431f3781dc08 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:00.442329 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a1057f63-c7ba-444a-ad85-431f3781dc08 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:00.459596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a1057f63-c7ba-444a-ad85-431f3781dc08 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:00.459980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a1057f63-c7ba-444a-ad85-431f3781dc08 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:00.460943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a1057f63-c7ba-444a-ad85-431f3781dc08 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:00.461381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a1057f63-c7ba-444a-ad85-431f3781dc08 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:00.568604 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a1057f63-c7ba-444a-ad85-431f3781dc08 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:00.577764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a1057f63-c7ba-444a-ad85-431f3781dc08 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1279 microversion: 2.1 time: 0.145925 Jun 21 15:56:00.594468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 143/290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:00 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:01.222671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-9aec7e6a-cb81-45c5-9c4e-6129badb3b89 req-3650957c-8ddb-4ed1-9224-d83fb4f21cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81775f43-85e6-49c7-9f5c-adeff449bb59", "tag": "d386ad21-9f3a-498f-a971-ba7627c4e5a1"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:01.253000 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-9aec7e6a-cb81-45c5-9c4e-6129badb3b89 req-3650957c-8ddb-4ed1-9224-d83fb4f21cd0 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:01.253852 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-9aec7e6a-cb81-45c5-9c4e-6129badb3b89 req-3650957c-8ddb-4ed1-9224-d83fb4f21cd0 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:01.262314 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=52 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:01.273492 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-9aec7e6a-cb81-45c5-9c4e-6129badb3b89 req-3650957c-8ddb-4ed1-9224-d83fb4f21cd0 service nova] Creating event network-changed:d386ad21-9f3a-498f-a971-ba7627c4e5a1 for instance 81775f43-85e6-49c7-9f5c-adeff449bb59 on hv-cinder-84067 Jun 21 15:56:01.280509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-9aec7e6a-cb81-45c5-9c4e-6129badb3b89 req-3650957c-8ddb-4ed1-9224-d83fb4f21cd0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061755 Jun 21 15:56:01.281465 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 148/291] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:56:01.595841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-98df82ae-cf92-4b6e-b85b-49641f11aba9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:01.596431 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-98df82ae-cf92-4b6e-b85b-49641f11aba9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:01.603423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98df82ae-cf92-4b6e-b85b-49641f11aba9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:01.604129 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98df82ae-cf92-4b6e-b85b-49641f11aba9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:01.604675 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98df82ae-cf92-4b6e-b85b-49641f11aba9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:01.605103 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98df82ae-cf92-4b6e-b85b-49641f11aba9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:01.740439 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-98df82ae-cf92-4b6e-b85b-49641f11aba9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:01.749708 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-98df82ae-cf92-4b6e-b85b-49641f11aba9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.157750 Jun 21 15:56:01.750521 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 144/292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:01 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:02.769036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4af39875-47e6-4269-a541-497578b5b39b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:02.769728 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4af39875-47e6-4269-a541-497578b5b39b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:02.777021 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4af39875-47e6-4269-a541-497578b5b39b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:02.777439 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4af39875-47e6-4269-a541-497578b5b39b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:02.778546 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4af39875-47e6-4269-a541-497578b5b39b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:02.778970 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4af39875-47e6-4269-a541-497578b5b39b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:02.969710 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4af39875-47e6-4269-a541-497578b5b39b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:02.987801 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4af39875-47e6-4269-a541-497578b5b39b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.223404 Jun 21 15:56:02.988958 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 149/293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:02 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:03.311401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-4240121d-b909-4140-a54c-d8fcbf7af2a4 req-12b84ad2-ca73-4eec-b6ed-8c0ffac728a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef6a0f84-f623-4591-98ec-44888b07337d", "tag": "1aa4a2b5-b308-481b-a519-cb4e91e3d01c"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:03.322398 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-4240121d-b909-4140-a54c-d8fcbf7af2a4 req-12b84ad2-ca73-4eec-b6ed-8c0ffac728a8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:03.323210 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-4240121d-b909-4140-a54c-d8fcbf7af2a4 req-12b84ad2-ca73-4eec-b6ed-8c0ffac728a8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:03.336951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-4240121d-b909-4140-a54c-d8fcbf7af2a4 req-12b84ad2-ca73-4eec-b6ed-8c0ffac728a8 service nova] Creating event network-changed:1aa4a2b5-b308-481b-a519-cb4e91e3d01c for instance ef6a0f84-f623-4591-98ec-44888b07337d on hv-cinder-84067 Jun 21 15:56:03.343596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-4240121d-b909-4140-a54c-d8fcbf7af2a4 req-12b84ad2-ca73-4eec-b6ed-8c0ffac728a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036978 Jun 21 15:56:03.344626 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 145/294] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:56:04.010148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-36075742-4e13-494a-9516-76d9333ac026 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:04.011598 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-36075742-4e13-494a-9516-76d9333ac026 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:04.020691 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-36075742-4e13-494a-9516-76d9333ac026 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:04.021351 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-36075742-4e13-494a-9516-76d9333ac026 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:04.022578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-36075742-4e13-494a-9516-76d9333ac026 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:04.023712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-36075742-4e13-494a-9516-76d9333ac026 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:04.178185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-36075742-4e13-494a-9516-76d9333ac026 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:04.191076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-36075742-4e13-494a-9516-76d9333ac026 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.189310 Jun 21 15:56:04.192113 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 150/295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:03 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:05.214000 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-075e8ede-39bc-4a28-a4f5-3398c140f418 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:05.214759 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-075e8ede-39bc-4a28-a4f5-3398c140f418 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:05.221173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-075e8ede-39bc-4a28-a4f5-3398c140f418 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:05.221700 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-075e8ede-39bc-4a28-a4f5-3398c140f418 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:05.222698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-075e8ede-39bc-4a28-a4f5-3398c140f418 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:05.223287 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-075e8ede-39bc-4a28-a4f5-3398c140f418 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:05.377112 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-075e8ede-39bc-4a28-a4f5-3398c140f418 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:05.387681 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-075e8ede-39bc-4a28-a4f5-3398c140f418 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.178296 Jun 21 15:56:05.391893 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 146/296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:05 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:06.405245 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-04c0c09b-5e5f-4ed6-8dd3-db013916b36f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:06.406167 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-04c0c09b-5e5f-4ed6-8dd3-db013916b36f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:06.415147 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04c0c09b-5e5f-4ed6-8dd3-db013916b36f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:06.416244 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04c0c09b-5e5f-4ed6-8dd3-db013916b36f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:06.417559 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04c0c09b-5e5f-4ed6-8dd3-db013916b36f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:06.417976 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04c0c09b-5e5f-4ed6-8dd3-db013916b36f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:06.573480 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-04c0c09b-5e5f-4ed6-8dd3-db013916b36f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:06.583637 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-04c0c09b-5e5f-4ed6-8dd3-db013916b36f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.182600 Jun 21 15:56:06.584226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 151/297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:06 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:07.601280 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f0cc8456-a84c-4fe4-8ab3-281465e0a407 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:07.601951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f0cc8456-a84c-4fe4-8ab3-281465e0a407 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:07.608562 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0cc8456-a84c-4fe4-8ab3-281465e0a407 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:07.609006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0cc8456-a84c-4fe4-8ab3-281465e0a407 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:07.609799 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0cc8456-a84c-4fe4-8ab3-281465e0a407 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:07.610267 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0cc8456-a84c-4fe4-8ab3-281465e0a407 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:07.752625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f0cc8456-a84c-4fe4-8ab3-281465e0a407 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:07.761952 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f0cc8456-a84c-4fe4-8ab3-281465e0a407 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.164970 Jun 21 15:56:07.762904 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 147/298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:07 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:08.782259 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0e278d49-b56c-410a-a17c-e94a72a282a6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:08.783022 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0e278d49-b56c-410a-a17c-e94a72a282a6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:08.785700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=4 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:08.786384 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=12 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:08.793525 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0e278d49-b56c-410a-a17c-e94a72a282a6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:08.793990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0e278d49-b56c-410a-a17c-e94a72a282a6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:08.794763 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0e278d49-b56c-410a-a17c-e94a72a282a6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:08.795185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0e278d49-b56c-410a-a17c-e94a72a282a6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:08.939486 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-06e137a5-659a-4422-9f42-89446a8a783b req-b4055986-250e-4ed1-94a0-8ffd2eb08d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81775f43-85e6-49c7-9f5c-adeff449bb59", "name": "network-vif-plugged", "status": "completed", "tag": "d386ad21-9f3a-498f-a971-ba7627c4e5a1"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:08.941139 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0e278d49-b56c-410a-a17c-e94a72a282a6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:08.948638 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=4 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:08.949805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0e278d49-b56c-410a-a17c-e94a72a282a6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.172538 Jun 21 15:56:08.950374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 152/299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:08 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:08.959075 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-06e137a5-659a-4422-9f42-89446a8a783b req-b4055986-250e-4ed1-94a0-8ffd2eb08d44 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:08.959835 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-06e137a5-659a-4422-9f42-89446a8a783b req-b4055986-250e-4ed1-94a0-8ffd2eb08d44 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:08.973444 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-06e137a5-659a-4422-9f42-89446a8a783b req-b4055986-250e-4ed1-94a0-8ffd2eb08d44 service nova] Creating event network-vif-plugged:d386ad21-9f3a-498f-a971-ba7627c4e5a1 for instance 81775f43-85e6-49c7-9f5c-adeff449bb59 on hv-cinder-84067 Jun 21 15:56:08.981285 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-06e137a5-659a-4422-9f42-89446a8a783b req-b4055986-250e-4ed1-94a0-8ffd2eb08d44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046216 Jun 21 15:56:08.982394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 148/300] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:56:09.967463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7e923c76-2767-4cf2-bc08-926a72c9c59a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:09.968057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7e923c76-2767-4cf2-bc08-926a72c9c59a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:09.976901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7e923c76-2767-4cf2-bc08-926a72c9c59a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:09.977476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7e923c76-2767-4cf2-bc08-926a72c9c59a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:09.978690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7e923c76-2767-4cf2-bc08-926a72c9c59a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:09.979315 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7e923c76-2767-4cf2-bc08-926a72c9c59a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:10.119878 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7e923c76-2767-4cf2-bc08-926a72c9c59a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:10.128999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7e923c76-2767-4cf2-bc08-926a72c9c59a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.165142 Jun 21 15:56:10.129731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 153/301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:09 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:11.150614 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-78475615-d862-49ac-b704-3c7e257b0dd5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:11.151955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-78475615-d862-49ac-b704-3c7e257b0dd5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:11.162612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-78475615-d862-49ac-b704-3c7e257b0dd5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:11.163322 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-78475615-d862-49ac-b704-3c7e257b0dd5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:11.164514 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-78475615-d862-49ac-b704-3c7e257b0dd5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:11.164971 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-78475615-d862-49ac-b704-3c7e257b0dd5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:11.307258 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-78475615-d862-49ac-b704-3c7e257b0dd5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:11.314960 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-78475615-d862-49ac-b704-3c7e257b0dd5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.171314 Jun 21 15:56:11.315522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 149/302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:11 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:12.331717 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-207ab816-e842-4835-8d66-2f7c62935b97 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:12.332336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-207ab816-e842-4835-8d66-2f7c62935b97 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:12.339808 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-207ab816-e842-4835-8d66-2f7c62935b97 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:12.340246 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-207ab816-e842-4835-8d66-2f7c62935b97 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:12.340994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-207ab816-e842-4835-8d66-2f7c62935b97 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:12.341417 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-207ab816-e842-4835-8d66-2f7c62935b97 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:12.486231 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-207ab816-e842-4835-8d66-2f7c62935b97 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:12.496669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-207ab816-e842-4835-8d66-2f7c62935b97 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.168599 Jun 21 15:56:12.497495 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 154/303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:12 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:13.518635 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1b15b34c-a2bf-48dd-a020-12c220a451c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:13.519184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1b15b34c-a2bf-48dd-a020-12c220a451c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:13.526832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1b15b34c-a2bf-48dd-a020-12c220a451c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:13.527393 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1b15b34c-a2bf-48dd-a020-12c220a451c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:13.528160 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1b15b34c-a2bf-48dd-a020-12c220a451c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:13.528585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1b15b34c-a2bf-48dd-a020-12c220a451c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:13.675208 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1b15b34c-a2bf-48dd-a020-12c220a451c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:13.684074 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1b15b34c-a2bf-48dd-a020-12c220a451c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.171204 Jun 21 15:56:13.684638 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 150/304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:13 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:14.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9ecdbe56-261b-4179-80de-33215b34894b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:14.712077 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9ecdbe56-261b-4179-80de-33215b34894b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:14.719203 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ecdbe56-261b-4179-80de-33215b34894b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:14.719748 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ecdbe56-261b-4179-80de-33215b34894b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:14.720596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ecdbe56-261b-4179-80de-33215b34894b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:14.721086 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ecdbe56-261b-4179-80de-33215b34894b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:14.865034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9ecdbe56-261b-4179-80de-33215b34894b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:14.874377 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9ecdbe56-261b-4179-80de-33215b34894b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.170308 Jun 21 15:56:14.875045 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 155/305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:14 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:15.893300 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b636045a-4e8d-48c7-9a71-0a4cd89b9025 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:15.894135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b636045a-4e8d-48c7-9a71-0a4cd89b9025 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:15.901227 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b636045a-4e8d-48c7-9a71-0a4cd89b9025 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:15.901493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b636045a-4e8d-48c7-9a71-0a4cd89b9025 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:15.902279 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b636045a-4e8d-48c7-9a71-0a4cd89b9025 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:15.902721 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b636045a-4e8d-48c7-9a71-0a4cd89b9025 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:16.046736 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b636045a-4e8d-48c7-9a71-0a4cd89b9025 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:16.055141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b636045a-4e8d-48c7-9a71-0a4cd89b9025 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.165703 Jun 21 15:56:16.055954 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 151/306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:15 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:16.530707 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-294719042", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:16.538090 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:16.594399 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] validate_networks() for None {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:56:16.662769 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-9a5b1bf6-3915-4257-bf63-3a094dd85817 req-17274e70-f445-4b0b-aee7-043abe2e1bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6a0f84-f623-4591-98ec-44888b07337d", "name": "network-vif-plugged", "status": "completed", "tag": "1aa4a2b5-b308-481b-a519-cb4e91e3d01c"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:16.673008 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-9a5b1bf6-3915-4257-bf63-3a094dd85817 req-17274e70-f445-4b0b-aee7-043abe2e1bcb service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:16.674024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-9a5b1bf6-3915-4257-bf63-3a094dd85817 req-17274e70-f445-4b0b-aee7-043abe2e1bcb service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:16.687388 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-9a5b1bf6-3915-4257-bf63-3a094dd85817 req-17274e70-f445-4b0b-aee7-043abe2e1bcb service nova] Creating event network-vif-plugged:1aa4a2b5-b308-481b-a519-cb4e91e3d01c for instance ef6a0f84-f623-4591-98ec-44888b07337d on hv-cinder-84067 Jun 21 15:56:16.692899 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-9a5b1bf6-3915-4257-bf63-3a094dd85817 req-17274e70-f445-4b0b-aee7-043abe2e1bcb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Jun 21 15:56:16.693745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 152/307] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:56:16.896187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:56:16.896718 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:56:16.897275 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:56:16.897979 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:56:16.898938 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:56:16.908109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:16.908558 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:16.909405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:16.910061 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:16.928797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Getting quotas for project 661449a8a10e4d14afad24c30d845db5. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:56:16.935179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Getting quotas for user a45070e6409f460196d7560b2eb4becd and project 661449a8a10e4d14afad24c30d845db5. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:56:16.950014 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:56:16.952583 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:56:17.001179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-10899ef4-20d9-4b24-bfd9-ce2693b8b781 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474300 Jun 21 15:56:17.002191 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 156/308] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:56:17.013459 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-476bacf0-55f2-4084-be43-11f73c8eee99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:17.014319 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-476bacf0-55f2-4084-be43-11f73c8eee99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:17.073145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-850fa433-57a9-4289-b5b5-f0d1fbe78fa5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:17.073897 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-850fa433-57a9-4289-b5b5-f0d1fbe78fa5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:17.076602 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-476bacf0-55f2-4084-be43-11f73c8eee99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:17.080941 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-850fa433-57a9-4289-b5b5-f0d1fbe78fa5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:17.081385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-850fa433-57a9-4289-b5b5-f0d1fbe78fa5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:17.082170 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-850fa433-57a9-4289-b5b5-f0d1fbe78fa5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:17.082631 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-850fa433-57a9-4289-b5b5-f0d1fbe78fa5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:17.084028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-476bacf0-55f2-4084-be43-11f73c8eee99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1214 microversion: 2.1 time: 0.074677 Jun 21 15:56:17.085008 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 153/309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:17 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:17.242015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-850fa433-57a9-4289-b5b5-f0d1fbe78fa5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:17.252169 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-850fa433-57a9-4289-b5b5-f0d1fbe78fa5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.183361 Jun 21 15:56:17.252821 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 157/310] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:17 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:18.104889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-13bc2110-4fdc-4fd3-b07d-5f408b3f8500 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:18.105490 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-13bc2110-4fdc-4fd3-b07d-5f408b3f8500 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:18.112030 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13bc2110-4fdc-4fd3-b07d-5f408b3f8500 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:18.112465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13bc2110-4fdc-4fd3-b07d-5f408b3f8500 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:18.113354 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13bc2110-4fdc-4fd3-b07d-5f408b3f8500 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:18.114590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13bc2110-4fdc-4fd3-b07d-5f408b3f8500 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:18.199488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-13bc2110-4fdc-4fd3-b07d-5f408b3f8500 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:18.211877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-13bc2110-4fdc-4fd3-b07d-5f408b3f8500 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1210 microversion: 2.1 time: 0.113349 Jun 21 15:56:18.212743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 154/311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:18 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:18.268847 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-005e1928-2c47-4498-8326-e7546cd26174 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:18.269452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-005e1928-2c47-4498-8326-e7546cd26174 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:18.276434 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-005e1928-2c47-4498-8326-e7546cd26174 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:18.276877 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-005e1928-2c47-4498-8326-e7546cd26174 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:18.277867 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-005e1928-2c47-4498-8326-e7546cd26174 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:18.278304 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-005e1928-2c47-4498-8326-e7546cd26174 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:18.417213 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-005e1928-2c47-4498-8326-e7546cd26174 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:18.424837 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-005e1928-2c47-4498-8326-e7546cd26174 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1321 microversion: 2.1 time: 0.159887 Jun 21 15:56:18.425409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 158/312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:18 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:19.229024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dfbe402f-136b-44d0-a610-20cf7dd4c779 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:19.229897 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dfbe402f-136b-44d0-a610-20cf7dd4c779 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:19.236596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dfbe402f-136b-44d0-a610-20cf7dd4c779 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:19.237251 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dfbe402f-136b-44d0-a610-20cf7dd4c779 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:19.238201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dfbe402f-136b-44d0-a610-20cf7dd4c779 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:19.238770 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dfbe402f-136b-44d0-a610-20cf7dd4c779 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:19.331599 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-dfbe402f-136b-44d0-a610-20cf7dd4c779 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:19.342644 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dfbe402f-136b-44d0-a610-20cf7dd4c779 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1272 microversion: 2.1 time: 0.117161 Jun 21 15:56:19.343520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 155/313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:19 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:19.441076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9f2fb524-c8ba-4011-a561-a887628030b4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:19.441862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9f2fb524-c8ba-4011-a561-a887628030b4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:19.449641 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9f2fb524-c8ba-4011-a561-a887628030b4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:19.450410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9f2fb524-c8ba-4011-a561-a887628030b4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:19.451368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9f2fb524-c8ba-4011-a561-a887628030b4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:19.451821 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9f2fb524-c8ba-4011-a561-a887628030b4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:19.597130 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9f2fb524-c8ba-4011-a561-a887628030b4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:19.606247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9f2fb524-c8ba-4011-a561-a887628030b4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1516 microversion: 2.1 time: 0.169023 Jun 21 15:56:19.606886 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 159/314] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:19 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:19.624567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-772645d2-84e3-4df9-98b4-df61164e2a3d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:19.626121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-772645d2-84e3-4df9-98b4-df61164e2a3d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:19.634086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-772645d2-84e3-4df9-98b4-df61164e2a3d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:19.634588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-772645d2-84e3-4df9-98b4-df61164e2a3d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:19.635972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-772645d2-84e3-4df9-98b4-df61164e2a3d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:19.636458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-772645d2-84e3-4df9-98b4-df61164e2a3d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:19.664124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-772645d2-84e3-4df9-98b4-df61164e2a3d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lazy-loading 'flavor' on Instance uuid ef6a0f84-f623-4591-98ec-44888b07337d {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 15:56:19.936919 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-772645d2-84e3-4df9-98b4-df61164e2a3d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d/action" status: 200 len: 32 microversion: 2.1 time: 0.317140 Jun 21 15:56:19.937672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 156/315] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 15:56:19 2022] POST /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d/action => generated 32 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 15:56:19.954704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9ff04a60-e3c8-43c5-beb9-12109c1b9902 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:19.955347 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9ff04a60-e3c8-43c5-beb9-12109c1b9902 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:19.962976 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ff04a60-e3c8-43c5-beb9-12109c1b9902 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:19.963418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ff04a60-e3c8-43c5-beb9-12109c1b9902 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:19.964201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ff04a60-e3c8-43c5-beb9-12109c1b9902 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:19.964857 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ff04a60-e3c8-43c5-beb9-12109c1b9902 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:20.127309 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9ff04a60-e3c8-43c5-beb9-12109c1b9902 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:20.150429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9ff04a60-e3c8-43c5-beb9-12109c1b9902 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.199052 Jun 21 15:56:20.153942 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 160/316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:19 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:20.365046 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-93ae140b-fa5c-4043-94b2-604552d04dd2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:20.366014 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-93ae140b-fa5c-4043-94b2-604552d04dd2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:20.374526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93ae140b-fa5c-4043-94b2-604552d04dd2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:20.374681 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93ae140b-fa5c-4043-94b2-604552d04dd2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:20.375880 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93ae140b-fa5c-4043-94b2-604552d04dd2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:20.377993 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93ae140b-fa5c-4043-94b2-604552d04dd2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:20.521870 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-93ae140b-fa5c-4043-94b2-604552d04dd2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:20.530049 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-93ae140b-fa5c-4043-94b2-604552d04dd2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1314 microversion: 2.1 time: 0.169275 Jun 21 15:56:20.530622 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 157/317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:20 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:21.135282 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-08d01d68-3fc2-4f06-8f27-f8eb9a961b19 req-25c4f92c-3ca9-4092-a6a9-c41153365441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fbf881-eb56-4dfe-a78e-0033bb06abc4", "tag": "5ce724f2-fa4c-41c3-8b39-d3df6548a308"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:21.144469 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-08d01d68-3fc2-4f06-8f27-f8eb9a961b19 req-25c4f92c-3ca9-4092-a6a9-c41153365441 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:21.148727 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-08d01d68-3fc2-4f06-8f27-f8eb9a961b19 req-25c4f92c-3ca9-4092-a6a9-c41153365441 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:21.168837 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b017b565-e992-4c3c-afe3-c1ca37f98f30 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:21.169730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b017b565-e992-4c3c-afe3-c1ca37f98f30 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:21.179843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b017b565-e992-4c3c-afe3-c1ca37f98f30 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:21.180291 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b017b565-e992-4c3c-afe3-c1ca37f98f30 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:21.181077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b017b565-e992-4c3c-afe3-c1ca37f98f30 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:21.181509 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b017b565-e992-4c3c-afe3-c1ca37f98f30 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:21.192635 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-08d01d68-3fc2-4f06-8f27-f8eb9a961b19 req-25c4f92c-3ca9-4092-a6a9-c41153365441 service nova] Creating event network-changed:5ce724f2-fa4c-41c3-8b39-d3df6548a308 for instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 on hv-cinder-84067 Jun 21 15:56:21.208172 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-08d01d68-3fc2-4f06-8f27-f8eb9a961b19 req-25c4f92c-3ca9-4092-a6a9-c41153365441 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076820 Jun 21 15:56:21.210774 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 161/318] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:56:21.358665 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b017b565-e992-4c3c-afe3-c1ca37f98f30 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:21.366943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b017b565-e992-4c3c-afe3-c1ca37f98f30 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.201852 Jun 21 15:56:21.376316 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 158/319] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:21 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:21.564836 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-218dda51-bafa-4fa6-9a1f-1ba9ca0fe034 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:21.565870 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-218dda51-bafa-4fa6-9a1f-1ba9ca0fe034 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:21.572316 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-218dda51-bafa-4fa6-9a1f-1ba9ca0fe034 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:21.572758 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-218dda51-bafa-4fa6-9a1f-1ba9ca0fe034 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:21.573702 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-218dda51-bafa-4fa6-9a1f-1ba9ca0fe034 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:21.574157 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-218dda51-bafa-4fa6-9a1f-1ba9ca0fe034 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:21.720329 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-218dda51-bafa-4fa6-9a1f-1ba9ca0fe034 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:21.731902 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-218dda51-bafa-4fa6-9a1f-1ba9ca0fe034 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1314 microversion: 2.1 time: 0.185023 Jun 21 15:56:21.732423 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 162/320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:21 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:22.384607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-70a36d57-a084-4fa8-86be-029b2201e7f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:22.385197 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-70a36d57-a084-4fa8-86be-029b2201e7f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:22.391859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-70a36d57-a084-4fa8-86be-029b2201e7f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:22.392226 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-70a36d57-a084-4fa8-86be-029b2201e7f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:22.393001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-70a36d57-a084-4fa8-86be-029b2201e7f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:22.393411 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-70a36d57-a084-4fa8-86be-029b2201e7f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:22.529935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-70a36d57-a084-4fa8-86be-029b2201e7f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:22.537596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-70a36d57-a084-4fa8-86be-029b2201e7f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.157469 Jun 21 15:56:22.538927 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 159/321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:22 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:22.748521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7aad4c39-7fb1-476d-848a-e3945e95fcd3 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:22.749134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7aad4c39-7fb1-476d-848a-e3945e95fcd3 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:22.757556 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7aad4c39-7fb1-476d-848a-e3945e95fcd3 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:22.758271 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7aad4c39-7fb1-476d-848a-e3945e95fcd3 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:22.761948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7aad4c39-7fb1-476d-848a-e3945e95fcd3 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:22.762390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7aad4c39-7fb1-476d-848a-e3945e95fcd3 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:23.125407 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7aad4c39-7fb1-476d-848a-e3945e95fcd3 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:23.135602 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7aad4c39-7fb1-476d-848a-e3945e95fcd3 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1314 microversion: 2.1 time: 0.390929 Jun 21 15:56:23.136173 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 163/322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:22 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:23.557277 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-71a6c55b-e38d-4d5e-9ef7-0479ddc05f50 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:23.557887 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-71a6c55b-e38d-4d5e-9ef7-0479ddc05f50 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:23.564657 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-71a6c55b-e38d-4d5e-9ef7-0479ddc05f50 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:23.565124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-71a6c55b-e38d-4d5e-9ef7-0479ddc05f50 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:23.565953 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-71a6c55b-e38d-4d5e-9ef7-0479ddc05f50 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:23.566403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-71a6c55b-e38d-4d5e-9ef7-0479ddc05f50 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:23.585837 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:23.712201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-71a6c55b-e38d-4d5e-9ef7-0479ddc05f50 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:23.721228 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-71a6c55b-e38d-4d5e-9ef7-0479ddc05f50 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.168345 Jun 21 15:56:23.721839 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 160/323] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:23 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:24.152433 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-20f179a0-ac54-4a05-ba67-94e1508a51e8 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:24.153035 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-20f179a0-ac54-4a05-ba67-94e1508a51e8 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:24.159739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20f179a0-ac54-4a05-ba67-94e1508a51e8 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:24.160186 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20f179a0-ac54-4a05-ba67-94e1508a51e8 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:24.160946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20f179a0-ac54-4a05-ba67-94e1508a51e8 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:24.161378 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20f179a0-ac54-4a05-ba67-94e1508a51e8 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:24.299516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-20f179a0-ac54-4a05-ba67-94e1508a51e8 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:24.307782 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-20f179a0-ac54-4a05-ba67-94e1508a51e8 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1314 microversion: 2.1 time: 0.159175 Jun 21 15:56:24.308346 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 164/324] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:24 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:24.739100 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-93302c17-c3ae-4275-b3ff-125f3dc029cc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:24.739653 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-93302c17-c3ae-4275-b3ff-125f3dc029cc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:24.746566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93302c17-c3ae-4275-b3ff-125f3dc029cc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:24.747246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93302c17-c3ae-4275-b3ff-125f3dc029cc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:24.747999 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93302c17-c3ae-4275-b3ff-125f3dc029cc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:24.748417 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93302c17-c3ae-4275-b3ff-125f3dc029cc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:24.895441 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-93302c17-c3ae-4275-b3ff-125f3dc029cc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:24.904665 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-93302c17-c3ae-4275-b3ff-125f3dc029cc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.169242 Jun 21 15:56:24.905148 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 161/325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:24 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:25.324591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9dbd9074-0753-4d7e-ac63-97ab61a1f9f6 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:25.325151 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9dbd9074-0753-4d7e-ac63-97ab61a1f9f6 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:25.331792 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9dbd9074-0753-4d7e-ac63-97ab61a1f9f6 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:25.332239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9dbd9074-0753-4d7e-ac63-97ab61a1f9f6 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:25.332988 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9dbd9074-0753-4d7e-ac63-97ab61a1f9f6 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:25.333418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9dbd9074-0753-4d7e-ac63-97ab61a1f9f6 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:25.465597 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9dbd9074-0753-4d7e-ac63-97ab61a1f9f6 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:25.475268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9dbd9074-0753-4d7e-ac63-97ab61a1f9f6 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1314 microversion: 2.1 time: 0.154551 Jun 21 15:56:25.475858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 165/326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:25 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:25.921332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4dc7a547-59a7-4e4e-9a68-5f8f32d8690b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:25.921972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4dc7a547-59a7-4e4e-9a68-5f8f32d8690b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:25.928164 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4dc7a547-59a7-4e4e-9a68-5f8f32d8690b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:25.928633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4dc7a547-59a7-4e4e-9a68-5f8f32d8690b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:25.929553 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4dc7a547-59a7-4e4e-9a68-5f8f32d8690b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:25.930031 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4dc7a547-59a7-4e4e-9a68-5f8f32d8690b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:26.070147 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4dc7a547-59a7-4e4e-9a68-5f8f32d8690b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:26.077715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4dc7a547-59a7-4e4e-9a68-5f8f32d8690b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.160228 Jun 21 15:56:26.078304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 162/327] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:25 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:26.495341 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-948431a6-1c79-4a62-bce4-3b0deb7e7b63 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:26.496334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-948431a6-1c79-4a62-bce4-3b0deb7e7b63 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:26.503004 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-948431a6-1c79-4a62-bce4-3b0deb7e7b63 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:26.503499 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-948431a6-1c79-4a62-bce4-3b0deb7e7b63 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:26.504268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-948431a6-1c79-4a62-bce4-3b0deb7e7b63 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:26.504761 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-948431a6-1c79-4a62-bce4-3b0deb7e7b63 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:26.643356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-948431a6-1c79-4a62-bce4-3b0deb7e7b63 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:26.646445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:26.654016 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-948431a6-1c79-4a62-bce4-3b0deb7e7b63 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1314 microversion: 2.1 time: 0.164742 Jun 21 15:56:26.654587 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 166/328] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:26 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:26.668905 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-e557ecd5-0fc4-423e-b764-5e6949dc3484 req-be5b4e1d-891d-49b7-9640-f99ff2779ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fbf881-eb56-4dfe-a78e-0033bb06abc4", "name": "network-vif-plugged", "status": "completed", "tag": "5ce724f2-fa4c-41c3-8b39-d3df6548a308"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:26.677388 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-e557ecd5-0fc4-423e-b764-5e6949dc3484 req-be5b4e1d-891d-49b7-9640-f99ff2779ddf service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:26.677980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-e557ecd5-0fc4-423e-b764-5e6949dc3484 req-be5b4e1d-891d-49b7-9640-f99ff2779ddf service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:26.689937 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-e557ecd5-0fc4-423e-b764-5e6949dc3484 req-be5b4e1d-891d-49b7-9640-f99ff2779ddf service nova] Creating event network-vif-plugged:5ce724f2-fa4c-41c3-8b39-d3df6548a308 for instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 on hv-cinder-84067 Jun 21 15:56:26.695798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-e557ecd5-0fc4-423e-b764-5e6949dc3484 req-be5b4e1d-891d-49b7-9640-f99ff2779ddf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030675 Jun 21 15:56:26.696380 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 163/329] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:56:27.097026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ddcd58fe-1cab-4fd9-ae4f-7702a8409133 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:27.097694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ddcd58fe-1cab-4fd9-ae4f-7702a8409133 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:27.100555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:27.101228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=6 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:27.108490 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ddcd58fe-1cab-4fd9-ae4f-7702a8409133 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:27.108957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ddcd58fe-1cab-4fd9-ae4f-7702a8409133 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:27.109752 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ddcd58fe-1cab-4fd9-ae4f-7702a8409133 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:27.110339 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ddcd58fe-1cab-4fd9-ae4f-7702a8409133 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:27.390655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ddcd58fe-1cab-4fd9-ae4f-7702a8409133 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:27.402277 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ddcd58fe-1cab-4fd9-ae4f-7702a8409133 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.309480 Jun 21 15:56:27.403196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 167/330] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:27 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:27.669397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:27.674625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-44e234e5-60ea-4c13-b812-616fff783c99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:27.675620 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-44e234e5-60ea-4c13-b812-616fff783c99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:27.678308 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=52 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:27.686843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-44e234e5-60ea-4c13-b812-616fff783c99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:27.687510 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-44e234e5-60ea-4c13-b812-616fff783c99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:27.688659 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-44e234e5-60ea-4c13-b812-616fff783c99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:27.689232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-44e234e5-60ea-4c13-b812-616fff783c99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:27.832387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-44e234e5-60ea-4c13-b812-616fff783c99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:27.840389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-44e234e5-60ea-4c13-b812-616fff783c99 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1314 microversion: 2.1 time: 0.172611 Jun 21 15:56:27.840951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 164/331] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:27 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:28.426523 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-af365fca-b96b-41d3-b13b-44482318318c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:28.427335 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-af365fca-b96b-41d3-b13b-44482318318c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:28.439236 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-af365fca-b96b-41d3-b13b-44482318318c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:28.439835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-af365fca-b96b-41d3-b13b-44482318318c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:28.440848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-af365fca-b96b-41d3-b13b-44482318318c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:28.441420 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-af365fca-b96b-41d3-b13b-44482318318c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:28.592208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-af365fca-b96b-41d3-b13b-44482318318c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:28.600307 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-af365fca-b96b-41d3-b13b-44482318318c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.179882 Jun 21 15:56:28.600873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 168/332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:28 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:28.857486 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dfa9528d-0364-4fa5-aad1-ae61c8a67a92 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:28.858144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dfa9528d-0364-4fa5-aad1-ae61c8a67a92 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:28.864222 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dfa9528d-0364-4fa5-aad1-ae61c8a67a92 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:28.864665 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dfa9528d-0364-4fa5-aad1-ae61c8a67a92 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:28.865515 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dfa9528d-0364-4fa5-aad1-ae61c8a67a92 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:28.866140 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dfa9528d-0364-4fa5-aad1-ae61c8a67a92 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:29.004146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-dfa9528d-0364-4fa5-aad1-ae61c8a67a92 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:29.014523 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dfa9528d-0364-4fa5-aad1-ae61c8a67a92 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1464 microversion: 2.1 time: 0.160870 Jun 21 15:56:29.015365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 165/333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:28 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:29.059476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-10ee9259-dfed-4b19-b0a0-cc4bd403ecfd tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:29.059958 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-10ee9259-dfed-4b19-b0a0-cc4bd403ecfd tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:29.066151 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-10ee9259-dfed-4b19-b0a0-cc4bd403ecfd tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:29.066599 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-10ee9259-dfed-4b19-b0a0-cc4bd403ecfd tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:29.067353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-10ee9259-dfed-4b19-b0a0-cc4bd403ecfd tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:29.067773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-10ee9259-dfed-4b19-b0a0-cc4bd403ecfd tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:29.094354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-10ee9259-dfed-4b19-b0a0-cc4bd403ecfd tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 15:56:29.197592 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-10ee9259-dfed-4b19-b0a0-cc4bd403ecfd tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 204 len: 0 microversion: 2.1 time: 0.142422 Jun 21 15:56:29.198210 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 169/334] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 15:56:29 2022] DELETE /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 15:56:29.206759 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3e93e29f-a631-45e6-a8c1-b22d36bba4cb tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:29.207290 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3e93e29f-a631-45e6-a8c1-b22d36bba4cb tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:29.214131 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3e93e29f-a631-45e6-a8c1-b22d36bba4cb tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:29.214569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3e93e29f-a631-45e6-a8c1-b22d36bba4cb tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:29.215310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3e93e29f-a631-45e6-a8c1-b22d36bba4cb tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:29.215729 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3e93e29f-a631-45e6-a8c1-b22d36bba4cb tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:29.351438 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3e93e29f-a631-45e6-a8c1-b22d36bba4cb tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:29.363076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3e93e29f-a631-45e6-a8c1-b22d36bba4cb tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1470 microversion: 2.1 time: 0.160175 Jun 21 15:56:29.363955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 166/335] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:29 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:29.617802 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-db572595-8468-485d-91d9-b3d53145087c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:29.618932 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-db572595-8468-485d-91d9-b3d53145087c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:29.626552 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-db572595-8468-485d-91d9-b3d53145087c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:29.626990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-db572595-8468-485d-91d9-b3d53145087c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:29.627746 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-db572595-8468-485d-91d9-b3d53145087c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:29.628175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-db572595-8468-485d-91d9-b3d53145087c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:29.775389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-db572595-8468-485d-91d9-b3d53145087c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:29.782924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-db572595-8468-485d-91d9-b3d53145087c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.169934 Jun 21 15:56:29.786788 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 170/336] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:29 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:30.381684 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-cd758ac9-9a90-40a0-ab86-e67ae1caa2e2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:30.382401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-cd758ac9-9a90-40a0-ab86-e67ae1caa2e2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:30.388843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cd758ac9-9a90-40a0-ab86-e67ae1caa2e2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:30.389283 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cd758ac9-9a90-40a0-ab86-e67ae1caa2e2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:30.390058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cd758ac9-9a90-40a0-ab86-e67ae1caa2e2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:30.390449 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cd758ac9-9a90-40a0-ab86-e67ae1caa2e2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:30.536140 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cd758ac9-9a90-40a0-ab86-e67ae1caa2e2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:30.547695 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-cd758ac9-9a90-40a0-ab86-e67ae1caa2e2 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1470 microversion: 2.1 time: 0.169980 Jun 21 15:56:30.548294 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 167/337] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:30 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:30.799640 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-29dcd5c4-0e4e-48b6-82c2-ac4eed6c0cb8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:30.800217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-29dcd5c4-0e4e-48b6-82c2-ac4eed6c0cb8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:30.807541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-29dcd5c4-0e4e-48b6-82c2-ac4eed6c0cb8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:30.807984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-29dcd5c4-0e4e-48b6-82c2-ac4eed6c0cb8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:30.808749 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-29dcd5c4-0e4e-48b6-82c2-ac4eed6c0cb8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:30.809223 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-29dcd5c4-0e4e-48b6-82c2-ac4eed6c0cb8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:30.957294 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-29dcd5c4-0e4e-48b6-82c2-ac4eed6c0cb8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:30.965691 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-29dcd5c4-0e4e-48b6-82c2-ac4eed6c0cb8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.169876 Jun 21 15:56:30.966269 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 171/338] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:30 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:31.565299 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-00fac441-51f1-478d-a8df-5e6c30f7f456 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:31.565927 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-00fac441-51f1-478d-a8df-5e6c30f7f456 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:31.572169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-00fac441-51f1-478d-a8df-5e6c30f7f456 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:31.572904 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-00fac441-51f1-478d-a8df-5e6c30f7f456 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:31.573650 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-00fac441-51f1-478d-a8df-5e6c30f7f456 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:31.574273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-00fac441-51f1-478d-a8df-5e6c30f7f456 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:31.808690 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-00fac441-51f1-478d-a8df-5e6c30f7f456 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45070e6409f460196d7560b2eb4becd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661449a8a10e4d14afad24c30d845db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:31.819059 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-00fac441-51f1-478d-a8df-5e6c30f7f456 tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 200 len: 1470 microversion: 2.1 time: 0.257367 Jun 21 15:56:31.819917 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 168/339] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:31 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:31.983820 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c6fadb0e-2f6d-45c6-b787-8d2e9c98255d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:31.984429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c6fadb0e-2f6d-45c6-b787-8d2e9c98255d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:31.998451 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c6fadb0e-2f6d-45c6-b787-8d2e9c98255d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:31.999624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c6fadb0e-2f6d-45c6-b787-8d2e9c98255d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:32.000618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c6fadb0e-2f6d-45c6-b787-8d2e9c98255d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:32.001322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c6fadb0e-2f6d-45c6-b787-8d2e9c98255d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:32.066785 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-5777bb2c-28ca-4dbd-be3a-27a8857ff35f req-a400a892-1606-4de2-b43f-f0e7b04519f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fbf881-eb56-4dfe-a78e-0033bb06abc4", "name": "network-vif-deleted", "tag": "5ce724f2-fa4c-41c3-8b39-d3df6548a308"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:32.089275 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-5777bb2c-28ca-4dbd-be3a-27a8857ff35f req-a400a892-1606-4de2-b43f-f0e7b04519f5 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:32.090157 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-5777bb2c-28ca-4dbd-be3a-27a8857ff35f req-a400a892-1606-4de2-b43f-f0e7b04519f5 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:32.120444 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-5777bb2c-28ca-4dbd-be3a-27a8857ff35f req-a400a892-1606-4de2-b43f-f0e7b04519f5 service nova] Creating event network-vif-deleted:5ce724f2-fa4c-41c3-8b39-d3df6548a308 for instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 on hv-cinder-84067 Jun 21 15:56:32.129223 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-5777bb2c-28ca-4dbd-be3a-27a8857ff35f req-a400a892-1606-4de2-b43f-f0e7b04519f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066438 Jun 21 15:56:32.130679 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 169/340] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:56:32.260776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c6fadb0e-2f6d-45c6-b787-8d2e9c98255d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:32.273040 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c6fadb0e-2f6d-45c6-b787-8d2e9c98255d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.292895 Jun 21 15:56:32.275031 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 172/341] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:31 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:32.836606 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:32.837305 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] [instance: 16fbf881-eb56-4dfe-a78e-0033bb06abc4] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:32.843657 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:32.844101 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:32.844856 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:32.845281 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:32.859512 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] HTTP exception thrown: Instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 could not be found. Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Request method failure captured: Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 HTTP/1.1 Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiseoeWuJ3S3kUMtouG8KzJ6I9xu3Lg0FsedsXnkZCKBCbAwmS-qbNTjuhLM9EgL55a72iZqJrxRp5lUMItWoIQH9Q90-4Iknro_8EihNzHkTBndjGVkgfv6YQrCQu9I62fXJag9TUnkwpuxBhPNwH-0UdZsB9VD-c5rBj1VRXj9c_lbs Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 661449a8a10e4d14afad24c30d845db5 Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesNegativeTest-1695694855 Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:56:32.861120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/661449a8a10e4d14afad24c30d845db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/661449a8a10e4d14afad24c30d845db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/661449a8a10e4d14afad24c30d845db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_661449a8a10e4d14afad24c30d845db5", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesNegativeTest-1695694855 Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 661449a8a10e4d14afad24c30d845db5 Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesNegativeTest-1695694855 Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesNegativeTest-1695694855-project Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: a45070e6409f460196d7560b2eb4becd Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesNegativeTest-1695694855-project Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 could not be found. Jun 21 15:56:32.862607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '16fbf881-eb56-4dfe-a78e-0033bb06abc4'} Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 could not be found. Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:56:32.863384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 could not be found. Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 could not be found. Jun 21 15:56:32.864563 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:56:32.866076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] Returning 404 to user: Instance 16fbf881-eb56-4dfe-a78e-0033bb06abc4 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:56:32.866076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b33f1ada-ac3b-4f76-bff5-33deedfa169c tempest-VolumesNegativeTest-1695694855 tempest-VolumesNegativeTest-1695694855-project] 10.222.0.52 "GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4" status: 404 len: 111 microversion: 2.1 time: 0.030419 Jun 21 15:56:32.866076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 170/342] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:32 2022] GET /compute/v2.1/servers/16fbf881-eb56-4dfe-a78e-0033bb06abc4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:56:33.291038 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-62d24670-39bf-4f52-9376-78069e91de0e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:33.291671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-62d24670-39bf-4f52-9376-78069e91de0e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:33.299222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-62d24670-39bf-4f52-9376-78069e91de0e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:33.299799 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-62d24670-39bf-4f52-9376-78069e91de0e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:33.300608 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-62d24670-39bf-4f52-9376-78069e91de0e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:33.301223 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-62d24670-39bf-4f52-9376-78069e91de0e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:33.437649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-62d24670-39bf-4f52-9376-78069e91de0e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:33.446162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-62d24670-39bf-4f52-9376-78069e91de0e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.159565 Jun 21 15:56:33.448379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 173/343] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:33 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:33.873428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1562366200", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "networks": [{"uuid": "cb13e47c-97e9-450a-a349-4a483a8e0968"}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:33.927588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] validate_networks() for [('cb13e47c-97e9-450a-a349-4a483a8e0968', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:56:34.354615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:56:34.355140 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:56:34.355702 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:56:34.356515 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:56:34.357007 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:56:34.367019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:34.367547 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:34.368477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:34.368986 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:34.388568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Getting quotas for project af3eba9c8dda4166accce40c556af46e. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:56:34.392977 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Getting quotas for user 32512d9ebcc8447a88b99da4181895e7 and project af3eba9c8dda4166accce40c556af46e. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:56:34.405747 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:56:34.408877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:56:34.458264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1bbec76a-9fc5-414c-ad70-c09f1dd579bc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588211 Jun 21 15:56:34.459339 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 171/344] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:56:34.465107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d04131b1-1667-4b2a-9c12-3edf6c3a912f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:34.466426 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d04131b1-1667-4b2a-9c12-3edf6c3a912f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:34.469950 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2029f7c5-cc95-4f77-b958-ad1a1cde306b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:34.470742 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2029f7c5-cc95-4f77-b958-ad1a1cde306b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:34.474097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d04131b1-1667-4b2a-9c12-3edf6c3a912f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:34.481625 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d04131b1-1667-4b2a-9c12-3edf6c3a912f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:34.482307 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d04131b1-1667-4b2a-9c12-3edf6c3a912f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:34.482718 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d04131b1-1667-4b2a-9c12-3edf6c3a912f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:34.563555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2029f7c5-cc95-4f77-b958-ad1a1cde306b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:34.572039 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2029f7c5-cc95-4f77-b958-ad1a1cde306b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1219 microversion: 2.1 time: 0.106165 Jun 21 15:56:34.572596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 172/345] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:34 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:34.671670 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d04131b1-1667-4b2a-9c12-3edf6c3a912f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:34.680281 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d04131b1-1667-4b2a-9c12-3edf6c3a912f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.220613 Jun 21 15:56:34.682124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 174/346] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:34 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:35.593339 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b92cf934-4579-4f3f-9655-4d81f77a6502 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:35.595258 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b92cf934-4579-4f3f-9655-4d81f77a6502 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:35.605358 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b92cf934-4579-4f3f-9655-4d81f77a6502 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:35.606559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b92cf934-4579-4f3f-9655-4d81f77a6502 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:35.607615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b92cf934-4579-4f3f-9655-4d81f77a6502 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:35.608268 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b92cf934-4579-4f3f-9655-4d81f77a6502 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:35.682712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b92cf934-4579-4f3f-9655-4d81f77a6502 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:35.698127 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-47eae212-687a-4b28-8484-39fd19ea3063 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:35.699564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-47eae212-687a-4b28-8484-39fd19ea3063 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:35.708597 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b92cf934-4579-4f3f-9655-4d81f77a6502 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1289 microversion: 2.1 time: 0.117187 Jun 21 15:56:35.710010 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 173/347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:35 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:35.719350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-47eae212-687a-4b28-8484-39fd19ea3063 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:35.719350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-47eae212-687a-4b28-8484-39fd19ea3063 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:35.719350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-47eae212-687a-4b28-8484-39fd19ea3063 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:35.719350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-47eae212-687a-4b28-8484-39fd19ea3063 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:35.885541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-47eae212-687a-4b28-8484-39fd19ea3063 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:35.894757 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-47eae212-687a-4b28-8484-39fd19ea3063 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.202110 Jun 21 15:56:35.895410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 175/348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:35 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:36.727280 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0056e2ae-243c-4ecc-a8f9-8a3bd4168002 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:36.727925 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0056e2ae-243c-4ecc-a8f9-8a3bd4168002 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:36.734765 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0056e2ae-243c-4ecc-a8f9-8a3bd4168002 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:36.735225 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0056e2ae-243c-4ecc-a8f9-8a3bd4168002 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:36.736021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0056e2ae-243c-4ecc-a8f9-8a3bd4168002 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:36.736442 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0056e2ae-243c-4ecc-a8f9-8a3bd4168002 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:36.826443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-c1f8c858-34ce-4471-b333-b81821fabc10 req-27abda78-7f8c-4a9e-8f8e-908ad7b42a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51b581b-07bc-41e2-9dfb-1db8bf770e8d", "tag": "61c59913-d0bf-44b8-b08a-75e6782dac10"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:36.836930 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-c1f8c858-34ce-4471-b333-b81821fabc10 req-27abda78-7f8c-4a9e-8f8e-908ad7b42a41 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:36.837278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-c1f8c858-34ce-4471-b333-b81821fabc10 req-27abda78-7f8c-4a9e-8f8e-908ad7b42a41 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:36.848975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-c1f8c858-34ce-4471-b333-b81821fabc10 req-27abda78-7f8c-4a9e-8f8e-908ad7b42a41 service nova] Creating event network-changed:61c59913-d0bf-44b8-b08a-75e6782dac10 for instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d on hv-cinder-84067 Jun 21 15:56:36.855055 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-c1f8c858-34ce-4471-b333-b81821fabc10 req-27abda78-7f8c-4a9e-8f8e-908ad7b42a41 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032099 Jun 21 15:56:36.855813 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 176/349] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:56:36.892059 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0056e2ae-243c-4ecc-a8f9-8a3bd4168002 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:36.900083 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0056e2ae-243c-4ecc-a8f9-8a3bd4168002 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1319 microversion: 2.1 time: 0.177179 Jun 21 15:56:36.900711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 174/350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:36 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:36.911859 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b0fe20de-6dc7-437a-8780-c58348cc22bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:36.912555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b0fe20de-6dc7-437a-8780-c58348cc22bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:36.919326 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b0fe20de-6dc7-437a-8780-c58348cc22bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:36.921373 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b0fe20de-6dc7-437a-8780-c58348cc22bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:36.922181 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b0fe20de-6dc7-437a-8780-c58348cc22bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:36.923197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b0fe20de-6dc7-437a-8780-c58348cc22bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:37.080185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b0fe20de-6dc7-437a-8780-c58348cc22bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:37.088812 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b0fe20de-6dc7-437a-8780-c58348cc22bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.181089 Jun 21 15:56:37.089305 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 177/351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:36 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:37.919251 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-91f6a033-7825-4b45-b29c-da5347c67c06 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:37.919840 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-91f6a033-7825-4b45-b29c-da5347c67c06 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:37.928994 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-91f6a033-7825-4b45-b29c-da5347c67c06 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:37.929453 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-91f6a033-7825-4b45-b29c-da5347c67c06 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:37.930239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-91f6a033-7825-4b45-b29c-da5347c67c06 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:37.930668 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-91f6a033-7825-4b45-b29c-da5347c67c06 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:38.072884 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-91f6a033-7825-4b45-b29c-da5347c67c06 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:38.080834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-91f6a033-7825-4b45-b29c-da5347c67c06 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1319 microversion: 2.1 time: 0.165524 Jun 21 15:56:38.081460 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 175/352] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:37 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:38.106797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-27355bc5-f4f6-432a-9dfe-3b257adc0e52 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:38.107519 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-27355bc5-f4f6-432a-9dfe-3b257adc0e52 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:38.114201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-27355bc5-f4f6-432a-9dfe-3b257adc0e52 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:38.114642 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-27355bc5-f4f6-432a-9dfe-3b257adc0e52 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:38.115761 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-27355bc5-f4f6-432a-9dfe-3b257adc0e52 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:38.116179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-27355bc5-f4f6-432a-9dfe-3b257adc0e52 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:38.257884 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-27355bc5-f4f6-432a-9dfe-3b257adc0e52 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:38.265622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-27355bc5-f4f6-432a-9dfe-3b257adc0e52 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.162916 Jun 21 15:56:38.266181 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 178/353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:38 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:39.100516 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ba21eeae-41c8-4bbe-9a00-ad6b388fe713 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:39.101732 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ba21eeae-41c8-4bbe-9a00-ad6b388fe713 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:39.108396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ba21eeae-41c8-4bbe-9a00-ad6b388fe713 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:39.109052 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ba21eeae-41c8-4bbe-9a00-ad6b388fe713 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:39.110023 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ba21eeae-41c8-4bbe-9a00-ad6b388fe713 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:39.110624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ba21eeae-41c8-4bbe-9a00-ad6b388fe713 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:39.269833 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ba21eeae-41c8-4bbe-9a00-ad6b388fe713 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:39.280379 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ba21eeae-41c8-4bbe-9a00-ad6b388fe713 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1319 microversion: 2.1 time: 0.184898 Jun 21 15:56:39.281616 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 176/354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:39 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:39.283668 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-36ebdde7-ce09-41c0-9ece-7e9e2ccc835d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:39.284369 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-36ebdde7-ce09-41c0-9ece-7e9e2ccc835d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:39.292562 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-36ebdde7-ce09-41c0-9ece-7e9e2ccc835d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:39.293307 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-36ebdde7-ce09-41c0-9ece-7e9e2ccc835d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:39.294159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-36ebdde7-ce09-41c0-9ece-7e9e2ccc835d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:39.294849 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-36ebdde7-ce09-41c0-9ece-7e9e2ccc835d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:39.445675 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-36ebdde7-ce09-41c0-9ece-7e9e2ccc835d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:39.454198 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-36ebdde7-ce09-41c0-9ece-7e9e2ccc835d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.174639 Jun 21 15:56:39.454794 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 179/355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:39 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:40.297410 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-507d5bdc-da5d-4bc1-a856-3bd39a787e4b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:40.298037 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-507d5bdc-da5d-4bc1-a856-3bd39a787e4b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:40.305376 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-507d5bdc-da5d-4bc1-a856-3bd39a787e4b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:40.305837 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-507d5bdc-da5d-4bc1-a856-3bd39a787e4b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:40.306595 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-507d5bdc-da5d-4bc1-a856-3bd39a787e4b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:40.307014 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-507d5bdc-da5d-4bc1-a856-3bd39a787e4b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:40.477498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-507d5bdc-da5d-4bc1-a856-3bd39a787e4b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:40.484715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-aecc2dd3-261f-4649-88ef-9a753ec9c497 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:40.486861 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-aecc2dd3-261f-4649-88ef-9a753ec9c497 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:40.496383 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-507d5bdc-da5d-4bc1-a856-3bd39a787e4b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1319 microversion: 2.1 time: 0.202649 Jun 21 15:56:40.500346 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aecc2dd3-261f-4649-88ef-9a753ec9c497 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:40.501083 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 177/356] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:40 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:40.501686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aecc2dd3-261f-4649-88ef-9a753ec9c497 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:40.502785 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aecc2dd3-261f-4649-88ef-9a753ec9c497 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:40.503415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aecc2dd3-261f-4649-88ef-9a753ec9c497 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:40.668678 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aecc2dd3-261f-4649-88ef-9a753ec9c497 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:40.678271 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-aecc2dd3-261f-4649-88ef-9a753ec9c497 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.208018 Jun 21 15:56:40.679133 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 180/357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:40 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:41.518695 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8865a3da-8377-470c-9d4a-55959f5a1605 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:41.519447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8865a3da-8377-470c-9d4a-55959f5a1605 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:41.532149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8865a3da-8377-470c-9d4a-55959f5a1605 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:41.532149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8865a3da-8377-470c-9d4a-55959f5a1605 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:41.532149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8865a3da-8377-470c-9d4a-55959f5a1605 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:41.532149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8865a3da-8377-470c-9d4a-55959f5a1605 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:41.689908 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8865a3da-8377-470c-9d4a-55959f5a1605 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:41.696043 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-256ad519-24df-40a0-929d-0e17577994d6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:41.696858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-256ad519-24df-40a0-929d-0e17577994d6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:41.703143 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8865a3da-8377-470c-9d4a-55959f5a1605 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1319 microversion: 2.1 time: 0.189287 Jun 21 15:56:41.704508 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-256ad519-24df-40a0-929d-0e17577994d6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:41.705323 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-256ad519-24df-40a0-929d-0e17577994d6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:41.706171 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-256ad519-24df-40a0-929d-0e17577994d6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:41.706779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-256ad519-24df-40a0-929d-0e17577994d6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:41.706967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 178/358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:41 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:41.863051 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-256ad519-24df-40a0-929d-0e17577994d6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:41.873219 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-256ad519-24df-40a0-929d-0e17577994d6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.181421 Jun 21 15:56:41.874152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 181/359] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:41 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:42.724151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b5b244eb-5804-434d-96de-1880ec205992 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:42.724766 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b5b244eb-5804-434d-96de-1880ec205992 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:42.731936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5b244eb-5804-434d-96de-1880ec205992 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:42.732376 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5b244eb-5804-434d-96de-1880ec205992 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:42.733127 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5b244eb-5804-434d-96de-1880ec205992 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:42.733749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5b244eb-5804-434d-96de-1880ec205992 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:42.891385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-879d30ef-33dd-4d32-913c-6cabffdf1aea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:42.892126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-879d30ef-33dd-4d32-913c-6cabffdf1aea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:42.902880 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b5b244eb-5804-434d-96de-1880ec205992 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:42.914148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-879d30ef-33dd-4d32-913c-6cabffdf1aea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:42.914885 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-879d30ef-33dd-4d32-913c-6cabffdf1aea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:42.915729 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-879d30ef-33dd-4d32-913c-6cabffdf1aea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:42.916160 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-879d30ef-33dd-4d32-913c-6cabffdf1aea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:42.916673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b5b244eb-5804-434d-96de-1880ec205992 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1319 microversion: 2.1 time: 0.196384 Jun 21 15:56:42.917716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 179/360] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:42 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:42.934753 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:42.953978 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-757eeb98-4712-46db-94de-497359ed7cc6 req-1a8c9e95-ee2d-453b-a85e-d1d9ecc162d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51b581b-07bc-41e2-9dfb-1db8bf770e8d", "name": "network-vif-plugged", "status": "completed", "tag": "61c59913-d0bf-44b8-b08a-75e6782dac10"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:42.965585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-757eeb98-4712-46db-94de-497359ed7cc6 req-1a8c9e95-ee2d-453b-a85e-d1d9ecc162d4 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:42.966234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-757eeb98-4712-46db-94de-497359ed7cc6 req-1a8c9e95-ee2d-453b-a85e-d1d9ecc162d4 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:42.986739 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-757eeb98-4712-46db-94de-497359ed7cc6 req-1a8c9e95-ee2d-453b-a85e-d1d9ecc162d4 service nova] Creating event network-vif-plugged:61c59913-d0bf-44b8-b08a-75e6782dac10 for instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d on hv-cinder-84067 Jun 21 15:56:43.000088 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-757eeb98-4712-46db-94de-497359ed7cc6 req-1a8c9e95-ee2d-453b-a85e-d1d9ecc162d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050434 Jun 21 15:56:43.002090 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 180/361] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:56:43.102398 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-879d30ef-33dd-4d32-913c-6cabffdf1aea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:43.114973 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-879d30ef-33dd-4d32-913c-6cabffdf1aea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.227429 Jun 21 15:56:43.116566 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 182/362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:42 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:43.935180 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-908d1c52-af1d-4374-bbef-2fd57ba714cc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:43.936478 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-908d1c52-af1d-4374-bbef-2fd57ba714cc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:43.948384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-908d1c52-af1d-4374-bbef-2fd57ba714cc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:43.948819 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-908d1c52-af1d-4374-bbef-2fd57ba714cc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:43.949951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-908d1c52-af1d-4374-bbef-2fd57ba714cc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:43.950353 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-908d1c52-af1d-4374-bbef-2fd57ba714cc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:43.971412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:44.105223 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-908d1c52-af1d-4374-bbef-2fd57ba714cc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:44.113580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-908d1c52-af1d-4374-bbef-2fd57ba714cc tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1319 microversion: 2.1 time: 0.184079 Jun 21 15:56:44.114480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 181/363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:43 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:44.133472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cec1fe20-a4f6-48bb-b187-5658428c7b40 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:44.134430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cec1fe20-a4f6-48bb-b187-5658428c7b40 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:44.141507 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cec1fe20-a4f6-48bb-b187-5658428c7b40 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:44.142064 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cec1fe20-a4f6-48bb-b187-5658428c7b40 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:44.143033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cec1fe20-a4f6-48bb-b187-5658428c7b40 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:44.143466 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cec1fe20-a4f6-48bb-b187-5658428c7b40 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:44.359917 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cec1fe20-a4f6-48bb-b187-5658428c7b40 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:44.369044 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cec1fe20-a4f6-48bb-b187-5658428c7b40 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.240278 Jun 21 15:56:44.369968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 183/364] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:44 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:45.128362 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:45.130025 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=8 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:45.136404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f0adb358-1cfc-4900-8cdb-af8173225a6c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:45.145316 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f0adb358-1cfc-4900-8cdb-af8173225a6c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:45.155629 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0adb358-1cfc-4900-8cdb-af8173225a6c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:45.156144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0adb358-1cfc-4900-8cdb-af8173225a6c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:45.156948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0adb358-1cfc-4900-8cdb-af8173225a6c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:45.157568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0adb358-1cfc-4900-8cdb-af8173225a6c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:45.360897 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f0adb358-1cfc-4900-8cdb-af8173225a6c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:45.370204 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f0adb358-1cfc-4900-8cdb-af8173225a6c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1319 microversion: 2.1 time: 0.241900 Jun 21 15:56:45.370799 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 182/365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:45 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:45.388218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-176aa2ff-3f0d-4c44-91ea-3a5704b0f352 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:45.388912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-176aa2ff-3f0d-4c44-91ea-3a5704b0f352 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:45.396814 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-176aa2ff-3f0d-4c44-91ea-3a5704b0f352 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:45.403292 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-176aa2ff-3f0d-4c44-91ea-3a5704b0f352 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:45.405282 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-176aa2ff-3f0d-4c44-91ea-3a5704b0f352 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:45.409400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-176aa2ff-3f0d-4c44-91ea-3a5704b0f352 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:45.580003 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-176aa2ff-3f0d-4c44-91ea-3a5704b0f352 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:45.590511 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-176aa2ff-3f0d-4c44-91ea-3a5704b0f352 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.206241 Jun 21 15:56:45.591143 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 184/366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:45 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:46.390681 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6575eaa9-309a-4c22-8295-204da62ace32 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:46.391419 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6575eaa9-309a-4c22-8295-204da62ace32 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:46.407346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6575eaa9-309a-4c22-8295-204da62ace32 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:46.407797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6575eaa9-309a-4c22-8295-204da62ace32 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:46.408762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6575eaa9-309a-4c22-8295-204da62ace32 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:46.409442 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6575eaa9-309a-4c22-8295-204da62ace32 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:46.608158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f0a999fe-fff2-4174-9dae-32837c915c18 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:46.609466 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f0a999fe-fff2-4174-9dae-32837c915c18 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:46.612059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:46.626223 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f0a999fe-fff2-4174-9dae-32837c915c18 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:46.627226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f0a999fe-fff2-4174-9dae-32837c915c18 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:46.628437 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f0a999fe-fff2-4174-9dae-32837c915c18 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:46.629051 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f0a999fe-fff2-4174-9dae-32837c915c18 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:46.807778 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6575eaa9-309a-4c22-8295-204da62ace32 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:46.824206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6575eaa9-309a-4c22-8295-204da62ace32 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1507 microversion: 2.1 time: 0.437467 Jun 21 15:56:46.824795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 183/367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:46 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1507 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:46.928703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f0a999fe-fff2-4174-9dae-32837c915c18 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:46.946010 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f0a999fe-fff2-4174-9dae-32837c915c18 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.341554 Jun 21 15:56:46.956589 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 185/368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:46 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:47.963924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d5569bc3-1c7e-43f2-955d-4cb4bc9af0c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:47.964904 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d5569bc3-1c7e-43f2-955d-4cb4bc9af0c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:47.971655 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d5569bc3-1c7e-43f2-955d-4cb4bc9af0c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:47.972751 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d5569bc3-1c7e-43f2-955d-4cb4bc9af0c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:47.973806 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d5569bc3-1c7e-43f2-955d-4cb4bc9af0c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:47.974432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d5569bc3-1c7e-43f2-955d-4cb4bc9af0c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:48.452198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d5569bc3-1c7e-43f2-955d-4cb4bc9af0c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:48.463297 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d5569bc3-1c7e-43f2-955d-4cb4bc9af0c4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.503919 Jun 21 15:56:48.475912 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 184/369] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:47 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:49.482687 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5464723d-4d75-41bf-a0be-a89fec8de39d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:49.484033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5464723d-4d75-41bf-a0be-a89fec8de39d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:49.495519 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5464723d-4d75-41bf-a0be-a89fec8de39d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:49.495973 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5464723d-4d75-41bf-a0be-a89fec8de39d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:49.496739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5464723d-4d75-41bf-a0be-a89fec8de39d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:49.497163 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5464723d-4d75-41bf-a0be-a89fec8de39d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:49.678744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5464723d-4d75-41bf-a0be-a89fec8de39d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:49.693216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5464723d-4d75-41bf-a0be-a89fec8de39d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.214265 Jun 21 15:56:49.708222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 186/370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:49 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:50.711468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-019748ab-7457-45c7-96f4-dabb329bfbe6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:50.712753 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-019748ab-7457-45c7-96f4-dabb329bfbe6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:50.719510 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-019748ab-7457-45c7-96f4-dabb329bfbe6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:50.720228 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-019748ab-7457-45c7-96f4-dabb329bfbe6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:50.720980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-019748ab-7457-45c7-96f4-dabb329bfbe6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:50.721919 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-019748ab-7457-45c7-96f4-dabb329bfbe6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:50.925433 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-019748ab-7457-45c7-96f4-dabb329bfbe6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:50.940089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-019748ab-7457-45c7-96f4-dabb329bfbe6 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.233284 Jun 21 15:56:50.942237 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 185/371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:50 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:51.960581 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-18e8af30-89cd-4828-bc4a-edcb26fff822 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:51.961243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-18e8af30-89cd-4828-bc4a-edcb26fff822 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:51.967873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-18e8af30-89cd-4828-bc4a-edcb26fff822 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:51.968584 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-18e8af30-89cd-4828-bc4a-edcb26fff822 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:51.969309 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-18e8af30-89cd-4828-bc4a-edcb26fff822 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:51.969725 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-18e8af30-89cd-4828-bc4a-edcb26fff822 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:52.127285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-18e8af30-89cd-4828-bc4a-edcb26fff822 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:52.138645 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-18e8af30-89cd-4828-bc4a-edcb26fff822 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.182236 Jun 21 15:56:52.139675 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 187/372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:51 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:53.156834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1e27cee9-ffc3-436a-bbe2-b8421962af15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:53.158470 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1e27cee9-ffc3-436a-bbe2-b8421962af15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:53.172434 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1e27cee9-ffc3-436a-bbe2-b8421962af15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:53.173289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1e27cee9-ffc3-436a-bbe2-b8421962af15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:53.174682 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1e27cee9-ffc3-436a-bbe2-b8421962af15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:53.178497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1e27cee9-ffc3-436a-bbe2-b8421962af15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:53.438664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1e27cee9-ffc3-436a-bbe2-b8421962af15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:53.447197 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1e27cee9-ffc3-436a-bbe2-b8421962af15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.294028 Jun 21 15:56:53.456346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 186/373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:53 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:54.463698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cf200f1a-ddf5-4f9f-b823-9c180ac0eadd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:54.464993 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cf200f1a-ddf5-4f9f-b823-9c180ac0eadd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:54.472282 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cf200f1a-ddf5-4f9f-b823-9c180ac0eadd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:54.473232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cf200f1a-ddf5-4f9f-b823-9c180ac0eadd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:54.474457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cf200f1a-ddf5-4f9f-b823-9c180ac0eadd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:54.475063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cf200f1a-ddf5-4f9f-b823-9c180ac0eadd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:54.636755 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cf200f1a-ddf5-4f9f-b823-9c180ac0eadd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:54.662201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cf200f1a-ddf5-4f9f-b823-9c180ac0eadd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.202256 Jun 21 15:56:54.672438 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 188/374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:54 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:55.679871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e3b72854-a9f9-4650-8075-bb236cb7b58f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:55.680454 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e3b72854-a9f9-4650-8075-bb236cb7b58f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:55.687325 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3b72854-a9f9-4650-8075-bb236cb7b58f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:55.688027 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3b72854-a9f9-4650-8075-bb236cb7b58f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:55.689061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3b72854-a9f9-4650-8075-bb236cb7b58f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:55.689843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3b72854-a9f9-4650-8075-bb236cb7b58f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:55.837798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e3b72854-a9f9-4650-8075-bb236cb7b58f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:55.846528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e3b72854-a9f9-4650-8075-bb236cb7b58f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.170700 Jun 21 15:56:55.847361 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 187/375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:55 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:56.863621 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cd0d3faa-c523-4605-8f7e-a903bd65fb64 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:56.864291 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cd0d3faa-c523-4605-8f7e-a903bd65fb64 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:56.873114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd0d3faa-c523-4605-8f7e-a903bd65fb64 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:56.873901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd0d3faa-c523-4605-8f7e-a903bd65fb64 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:56.874878 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd0d3faa-c523-4605-8f7e-a903bd65fb64 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:56.875485 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd0d3faa-c523-4605-8f7e-a903bd65fb64 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:57.025967 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cd0d3faa-c523-4605-8f7e-a903bd65fb64 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:57.034353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cd0d3faa-c523-4605-8f7e-a903bd65fb64 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.174888 Jun 21 15:56:57.035613 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 189/376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:56 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:56:58.052106 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b2d1ff38-fd4c-4370-8271-041b393a234e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:58.052659 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b2d1ff38-fd4c-4370-8271-041b393a234e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:58.055914 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:58.060343 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b2d1ff38-fd4c-4370-8271-041b393a234e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:58.061012 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b2d1ff38-fd4c-4370-8271-041b393a234e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:58.061801 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b2d1ff38-fd4c-4370-8271-041b393a234e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:58.062226 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b2d1ff38-fd4c-4370-8271-041b393a234e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:58.230704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b2d1ff38-fd4c-4370-8271-041b393a234e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:58.244499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b2d1ff38-fd4c-4370-8271-041b393a234e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.196877 Jun 21 15:56:58.245082 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 188/377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:58 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:56:59.011682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2a44f225-5eab-40f4-9813-7b122b2ed52e tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Action: 'create', calling method: .version_select at 0x7f73b607a700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1663921589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0Jh0v5S+5pI+4yZkqHnAMPfGncjhzM0vgJV3b9tA/mHuEyeL7eR3u2FX/xdh3T5XI5VNOqMdthNA3ITJp4vT4OhzpPPQ8FHLpdRpxtgbdeAPoiiPJZZk/BVikOugqpKQ=="}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:56:59.029557 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-2a44f225-5eab-40f4-9813-7b122b2ed52e tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Getting quotas for project 8716150d618c402fbb51a2a042c5ea5b. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:56:59.033619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-2a44f225-5eab-40f4-9813-7b122b2ed52e tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Getting quotas for user cc3f66be61f54ea8bac135cf7b3531dc and project 8716150d618c402fbb51a2a042c5ea5b. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:56:59.047087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2a44f225-5eab-40f4-9813-7b122b2ed52e tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [bfb5cf51-ed4e-43ee-8809-ab90856dcfac] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 15:56:59.267490 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a954d7be-5e1e-49f3-b955-eeaf3565dfa3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:56:59.268071 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a954d7be-5e1e-49f3-b955-eeaf3565dfa3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:56:59.275295 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a954d7be-5e1e-49f3-b955-eeaf3565dfa3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:59.275729 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a954d7be-5e1e-49f3-b955-eeaf3565dfa3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:59.276476 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a954d7be-5e1e-49f3-b955-eeaf3565dfa3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:56:59.276901 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a954d7be-5e1e-49f3-b955-eeaf3565dfa3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:56:59.416303 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a954d7be-5e1e-49f3-b955-eeaf3565dfa3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:56:59.423921 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a954d7be-5e1e-49f3-b955-eeaf3565dfa3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.162380 Jun 21 15:56:59.424513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 189/378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:56:59 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:00.055146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [None req-2a44f225-5eab-40f4-9813-7b122b2ed52e tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [bfb5cf51-ed4e-43ee-8809-ab90856dcfac] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 57030. Jun 21 15:57:00.073766 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2a44f225-5eab-40f4-9813-7b122b2ed52e tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.067960 Jun 21 15:57:00.074389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 190/379] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 15:56:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:00.130596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-311253925", "imageRef": "c39b8b9f-2851-4515-9e88-f327eeedbbfe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1663921589", "networks": [{"uuid": "e3f97455-6f64-43a6-8b8e-9dd84101a0c2"}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:00.182357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] validate_networks() for [('e3f97455-6f64-43a6-8b8e-9dd84101a0c2', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:57:00.443001 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b7cb24d0-c400-44ff-8e2a-f6c3bdd05769 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:00.443687 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b7cb24d0-c400-44ff-8e2a-f6c3bdd05769 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:00.450926 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7cb24d0-c400-44ff-8e2a-f6c3bdd05769 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:00.451372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7cb24d0-c400-44ff-8e2a-f6c3bdd05769 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:00.452134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7cb24d0-c400-44ff-8e2a-f6c3bdd05769 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:00.452568 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7cb24d0-c400-44ff-8e2a-f6c3bdd05769 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:00.670626 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:57:00.671626 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:57:00.672131 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:57:00.672577 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:57:00.673059 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:57:00.678071 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b7cb24d0-c400-44ff-8e2a-f6c3bdd05769 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:00.683809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:00.684255 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:00.685039 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:00.685471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:00.685694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b7cb24d0-c400-44ff-8e2a-f6c3bdd05769 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.248576 Jun 21 15:57:00.686285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 191/380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:00 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:00.704447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Getting quotas for project 8716150d618c402fbb51a2a042c5ea5b. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:57:00.709008 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Getting quotas for user cc3f66be61f54ea8bac135cf7b3531dc and project 8716150d618c402fbb51a2a042c5ea5b. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:57:00.719948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:57:00.722500 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c39b8b9f-2851-4515-9e88-f327eeedbbfe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:57:00.774306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-968fb22b-7fd9-4171-8e7b-3bfb6ff740a2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647578 Jun 21 15:57:00.775187 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 190/381] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:57:00.785197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4153f52f-2f3d-4ddb-85ea-183f2eb64f6b tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:00.785954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4153f52f-2f3d-4ddb-85ea-183f2eb64f6b tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:00.842036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4153f52f-2f3d-4ddb-85ea-183f2eb64f6b tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:00.849492 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4153f52f-2f3d-4ddb-85ea-183f2eb64f6b tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1258 microversion: 2.1 time: 0.068381 Jun 21 15:57:00.850104 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 192/382] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:00 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:01.704797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-db3dbcde-e329-447b-adb2-3589a5895a6a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:01.705428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-db3dbcde-e329-447b-adb2-3589a5895a6a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:01.713806 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-db3dbcde-e329-447b-adb2-3589a5895a6a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:01.714245 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-db3dbcde-e329-447b-adb2-3589a5895a6a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:01.715215 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-db3dbcde-e329-447b-adb2-3589a5895a6a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:01.715712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-db3dbcde-e329-447b-adb2-3589a5895a6a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:01.865369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-db3dbcde-e329-447b-adb2-3589a5895a6a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:01.867479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5d686d01-6ccd-4c48-9e41-a0082adebcbf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:01.868220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5d686d01-6ccd-4c48-9e41-a0082adebcbf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:01.875304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-db3dbcde-e329-447b-adb2-3589a5895a6a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1522 microversion: 2.1 time: 0.174479 Jun 21 15:57:01.875985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 191/383] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:01 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:01.887241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5d686d01-6ccd-4c48-9e41-a0082adebcbf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:01.887738 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5d686d01-6ccd-4c48-9e41-a0082adebcbf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:01.888548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5d686d01-6ccd-4c48-9e41-a0082adebcbf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:01.888942 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5d686d01-6ccd-4c48-9e41-a0082adebcbf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:01.957931 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5d686d01-6ccd-4c48-9e41-a0082adebcbf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:01.969284 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5d686d01-6ccd-4c48-9e41-a0082adebcbf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1310 microversion: 2.1 time: 0.105921 Jun 21 15:57:01.970125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 193/384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:01 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:02.893737 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6678d15a-e16a-4922-977f-22d03f2d82a3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:02.894420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6678d15a-e16a-4922-977f-22d03f2d82a3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:02.904642 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6678d15a-e16a-4922-977f-22d03f2d82a3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:02.905678 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6678d15a-e16a-4922-977f-22d03f2d82a3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:02.906911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6678d15a-e16a-4922-977f-22d03f2d82a3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:02.907608 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6678d15a-e16a-4922-977f-22d03f2d82a3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:02.989082 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-74cf81f0-4606-4d6e-8f34-017bd4e7523f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:02.990361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-74cf81f0-4606-4d6e-8f34-017bd4e7523f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:03.008209 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74cf81f0-4606-4d6e-8f34-017bd4e7523f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:03.008658 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74cf81f0-4606-4d6e-8f34-017bd4e7523f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:03.009488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74cf81f0-4606-4d6e-8f34-017bd4e7523f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:03.009980 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74cf81f0-4606-4d6e-8f34-017bd4e7523f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:03.273981 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6678d15a-e16a-4922-977f-22d03f2d82a3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:03.284662 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6678d15a-e16a-4922-977f-22d03f2d82a3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1502 microversion: 2.1 time: 0.395603 Jun 21 15:57:03.285873 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 192/385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:02 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1502 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:03.311329 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-51f60ad8-8812-4db8-8349-7b2822ae0bda tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:03.312181 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-51f60ad8-8812-4db8-8349-7b2822ae0bda tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:03.313219 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-74cf81f0-4606-4d6e-8f34-017bd4e7523f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:03.319617 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51f60ad8-8812-4db8-8349-7b2822ae0bda tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:03.320529 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51f60ad8-8812-4db8-8349-7b2822ae0bda tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:03.330202 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-74cf81f0-4606-4d6e-8f34-017bd4e7523f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.343041 Jun 21 15:57:03.330859 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 194/386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:02 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:03.334683 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51f60ad8-8812-4db8-8349-7b2822ae0bda tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:03.336198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51f60ad8-8812-4db8-8349-7b2822ae0bda tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:03.503005 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-51f60ad8-8812-4db8-8349-7b2822ae0bda tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:03.511235 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-51f60ad8-8812-4db8-8349-7b2822ae0bda tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1517 microversion: 2.1 time: 0.203797 Jun 21 15:57:03.518215 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 193/387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:03 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:04.348655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d893401c-c091-473a-990e-f36efa8e6411 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:04.349480 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d893401c-c091-473a-990e-f36efa8e6411 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:04.359589 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d893401c-c091-473a-990e-f36efa8e6411 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:04.360027 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d893401c-c091-473a-990e-f36efa8e6411 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:04.360785 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d893401c-c091-473a-990e-f36efa8e6411 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:04.361205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d893401c-c091-473a-990e-f36efa8e6411 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:04.512518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d893401c-c091-473a-990e-f36efa8e6411 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:04.520486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d893401c-c091-473a-990e-f36efa8e6411 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.176329 Jun 21 15:57:04.521344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 195/388] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:04 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:05.540605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-54dac607-db1c-4b8e-9326-83a04a3bff47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:05.542055 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-54dac607-db1c-4b8e-9326-83a04a3bff47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:05.548705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54dac607-db1c-4b8e-9326-83a04a3bff47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:05.549900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54dac607-db1c-4b8e-9326-83a04a3bff47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:05.560646 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54dac607-db1c-4b8e-9326-83a04a3bff47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:05.561281 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54dac607-db1c-4b8e-9326-83a04a3bff47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:05.702942 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54dac607-db1c-4b8e-9326-83a04a3bff47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:05.711040 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-54dac607-db1c-4b8e-9326-83a04a3bff47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.175785 Jun 21 15:57:05.711608 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 194/389] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:05 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:06.040235 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cfa29fcc-a374-4f58-a32f-401ea27f185c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:06.041253 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cfa29fcc-a374-4f58-a32f-401ea27f185c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:06.048590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cfa29fcc-a374-4f58-a32f-401ea27f185c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:06.049032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cfa29fcc-a374-4f58-a32f-401ea27f185c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:06.049852 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cfa29fcc-a374-4f58-a32f-401ea27f185c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:06.050243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cfa29fcc-a374-4f58-a32f-401ea27f185c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:06.075896 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-cfa29fcc-a374-4f58-a32f-401ea27f185c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lazy-loading 'flavor' on Instance uuid 81775f43-85e6-49c7-9f5c-adeff449bb59 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 15:57:06.209564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cfa29fcc-a374-4f58-a32f-401ea27f185c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59/action" status: 200 len: 32 microversion: 2.1 time: 0.174083 Jun 21 15:57:06.214313 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 196/390] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 15:57:06 2022] POST /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 15:57:06.219906 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6d80a5fe-c277-48a3-ad2d-9926de26fcf8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:06.220993 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6d80a5fe-c277-48a3-ad2d-9926de26fcf8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:06.228863 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6d80a5fe-c277-48a3-ad2d-9926de26fcf8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:06.230362 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6d80a5fe-c277-48a3-ad2d-9926de26fcf8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:06.231392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6d80a5fe-c277-48a3-ad2d-9926de26fcf8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:06.231976 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6d80a5fe-c277-48a3-ad2d-9926de26fcf8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:06.403440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6d80a5fe-c277-48a3-ad2d-9926de26fcf8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:06.412274 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6d80a5fe-c277-48a3-ad2d-9926de26fcf8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.196576 Jun 21 15:57:06.412900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 195/391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:06 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:06.731651 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4656b13c-9865-48da-8e68-4ed852bbed12 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:06.732837 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4656b13c-9865-48da-8e68-4ed852bbed12 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:06.741459 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4656b13c-9865-48da-8e68-4ed852bbed12 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:06.742014 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4656b13c-9865-48da-8e68-4ed852bbed12 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:06.742793 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4656b13c-9865-48da-8e68-4ed852bbed12 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:06.743229 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4656b13c-9865-48da-8e68-4ed852bbed12 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:06.893544 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4656b13c-9865-48da-8e68-4ed852bbed12 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:06.903474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4656b13c-9865-48da-8e68-4ed852bbed12 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.178530 Jun 21 15:57:06.904579 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 197/392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:06 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:07.431112 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8c66b7da-af1d-40da-b9fb-03c55967fbfa tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:07.431761 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8c66b7da-af1d-40da-b9fb-03c55967fbfa tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:07.438527 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8c66b7da-af1d-40da-b9fb-03c55967fbfa tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:07.439069 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8c66b7da-af1d-40da-b9fb-03c55967fbfa tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:07.439842 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8c66b7da-af1d-40da-b9fb-03c55967fbfa tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:07.440273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8c66b7da-af1d-40da-b9fb-03c55967fbfa tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:07.585057 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8c66b7da-af1d-40da-b9fb-03c55967fbfa tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:07.593659 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8c66b7da-af1d-40da-b9fb-03c55967fbfa tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.166715 Jun 21 15:57:07.594452 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 196/393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:07 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:07.921063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ba3e1cb9-6230-4d7d-afd0-41ec735f7401 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:07.921738 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ba3e1cb9-6230-4d7d-afd0-41ec735f7401 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:07.929372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ba3e1cb9-6230-4d7d-afd0-41ec735f7401 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:07.929899 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ba3e1cb9-6230-4d7d-afd0-41ec735f7401 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:07.931247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ba3e1cb9-6230-4d7d-afd0-41ec735f7401 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:07.931740 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ba3e1cb9-6230-4d7d-afd0-41ec735f7401 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:08.094474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ba3e1cb9-6230-4d7d-afd0-41ec735f7401 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:08.102774 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ba3e1cb9-6230-4d7d-afd0-41ec735f7401 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.185708 Jun 21 15:57:08.103338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 198/394] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:07 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:08.612726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0efaf362-be2c-4c1a-8448-e44f7202f844 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:08.613386 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0efaf362-be2c-4c1a-8448-e44f7202f844 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:08.619917 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0efaf362-be2c-4c1a-8448-e44f7202f844 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:08.620363 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0efaf362-be2c-4c1a-8448-e44f7202f844 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:08.621111 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0efaf362-be2c-4c1a-8448-e44f7202f844 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:08.621517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0efaf362-be2c-4c1a-8448-e44f7202f844 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:08.765948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0efaf362-be2c-4c1a-8448-e44f7202f844 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:08.774560 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0efaf362-be2c-4c1a-8448-e44f7202f844 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.165701 Jun 21 15:57:08.775322 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 197/395] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:08 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:09.120728 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e2fb5800-adec-46eb-920c-ffc784287d79 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:09.121366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e2fb5800-adec-46eb-920c-ffc784287d79 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:09.128426 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e2fb5800-adec-46eb-920c-ffc784287d79 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:09.128871 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e2fb5800-adec-46eb-920c-ffc784287d79 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:09.129624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e2fb5800-adec-46eb-920c-ffc784287d79 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:09.130077 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e2fb5800-adec-46eb-920c-ffc784287d79 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:09.132993 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:09.271319 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e2fb5800-adec-46eb-920c-ffc784287d79 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:09.279313 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e2fb5800-adec-46eb-920c-ffc784287d79 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.162404 Jun 21 15:57:09.280108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 199/396] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:09 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:09.791945 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-939d7c71-9593-494f-9121-7f4d1336d81a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:09.792564 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-939d7c71-9593-494f-9121-7f4d1336d81a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:09.799169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-939d7c71-9593-494f-9121-7f4d1336d81a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:09.799599 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-939d7c71-9593-494f-9121-7f4d1336d81a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:09.800366 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-939d7c71-9593-494f-9121-7f4d1336d81a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:09.800792 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-939d7c71-9593-494f-9121-7f4d1336d81a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:09.953975 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-939d7c71-9593-494f-9121-7f4d1336d81a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:09.957548 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:09.962930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-939d7c71-9593-494f-9121-7f4d1336d81a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.175205 Jun 21 15:57:09.971025 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 198/397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:09 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:10.296652 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a662fe2e-6c8a-4a8e-8604-b8fab4cf37f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:10.297238 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a662fe2e-6c8a-4a8e-8604-b8fab4cf37f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:10.304977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a662fe2e-6c8a-4a8e-8604-b8fab4cf37f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:10.305420 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a662fe2e-6c8a-4a8e-8604-b8fab4cf37f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:10.306296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a662fe2e-6c8a-4a8e-8604-b8fab4cf37f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:10.306713 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a662fe2e-6c8a-4a8e-8604-b8fab4cf37f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:10.444686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a662fe2e-6c8a-4a8e-8604-b8fab4cf37f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:10.452898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a662fe2e-6c8a-4a8e-8604-b8fab4cf37f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.160109 Jun 21 15:57:10.453703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 200/398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:10 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:10.834122 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ca8a3a63-f4a4-41bb-83cf-e5ec06f3f158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e5ff6bd-eee8-4617-bfb2-5bb7a473a6c2", "device": "/dev/sdb"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:10.835970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ca8a3a63-f4a4-41bb-83cf-e5ec06f3f158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:10.837920 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:10.838575 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=6 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:10.845410 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ca8a3a63-f4a4-41bb-83cf-e5ec06f3f158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:10.845884 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ca8a3a63-f4a4-41bb-83cf-e5ec06f3f158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:10.846652 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ca8a3a63-f4a4-41bb-83cf-e5ec06f3f158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:10.847095 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ca8a3a63-f4a4-41bb-83cf-e5ec06f3f158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:10.987736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3b7f71a9-2d58-4613-9564-95ec8396e3cd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:10.988433 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3b7f71a9-2d58-4613-9564-95ec8396e3cd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:10.990521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=6 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:10.997209 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3b7f71a9-2d58-4613-9564-95ec8396e3cd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:10.997669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3b7f71a9-2d58-4613-9564-95ec8396e3cd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:10.998454 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3b7f71a9-2d58-4613-9564-95ec8396e3cd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:10.998877 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3b7f71a9-2d58-4613-9564-95ec8396e3cd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:11.161494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3b7f71a9-2d58-4613-9564-95ec8396e3cd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:11.169594 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3b7f71a9-2d58-4613-9564-95ec8396e3cd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.185747 Jun 21 15:57:11.170238 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 201/399] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:10 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:11.264089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 15:57:11.264351 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Tue Jun 21 15:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d/os-volume_attachments (ip 10.222.0.52) !!! Jun 21 15:57:11.470730 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b7c2ffff-3d95-4875-a8e6-0f23f5353575 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:11.471382 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b7c2ffff-3d95-4875-a8e6-0f23f5353575 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:11.478875 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7c2ffff-3d95-4875-a8e6-0f23f5353575 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:11.479325 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7c2ffff-3d95-4875-a8e6-0f23f5353575 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:11.480102 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7c2ffff-3d95-4875-a8e6-0f23f5353575 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:11.480513 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7c2ffff-3d95-4875-a8e6-0f23f5353575 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:11.619255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b7c2ffff-3d95-4875-a8e6-0f23f5353575 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:11.627046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b7c2ffff-3d95-4875-a8e6-0f23f5353575 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.160704 Jun 21 15:57:11.627622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 202/400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:11 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:12.187077 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6ceeb393-0601-4d23-adf1-5ed2c3af8104 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:12.187703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6ceeb393-0601-4d23-adf1-5ed2c3af8104 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:12.194854 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ceeb393-0601-4d23-adf1-5ed2c3af8104 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:12.195118 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ceeb393-0601-4d23-adf1-5ed2c3af8104 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:12.196004 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ceeb393-0601-4d23-adf1-5ed2c3af8104 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:12.196501 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ceeb393-0601-4d23-adf1-5ed2c3af8104 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:12.349896 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6ceeb393-0601-4d23-adf1-5ed2c3af8104 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:12.358139 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6ceeb393-0601-4d23-adf1-5ed2c3af8104 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.175041 Jun 21 15:57:12.358718 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 203/401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:12 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:12.646896 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-bae58ef4-edf4-43c6-85f1-9655f4392116 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:12.648020 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-bae58ef4-edf4-43c6-85f1-9655f4392116 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:12.654966 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bae58ef4-edf4-43c6-85f1-9655f4392116 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:12.655409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bae58ef4-edf4-43c6-85f1-9655f4392116 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:12.656175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bae58ef4-edf4-43c6-85f1-9655f4392116 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:12.656594 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bae58ef4-edf4-43c6-85f1-9655f4392116 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:12.793239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bae58ef4-edf4-43c6-85f1-9655f4392116 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:12.801213 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-bae58ef4-edf4-43c6-85f1-9655f4392116 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.159832 Jun 21 15:57:12.801813 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 204/402] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:12 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:13.376564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b562dd10-3077-47af-b1d4-f5a454dd720c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:13.377081 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b562dd10-3077-47af-b1d4-f5a454dd720c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:13.385006 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b562dd10-3077-47af-b1d4-f5a454dd720c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:13.385505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b562dd10-3077-47af-b1d4-f5a454dd720c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:13.386356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b562dd10-3077-47af-b1d4-f5a454dd720c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:13.386791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b562dd10-3077-47af-b1d4-f5a454dd720c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:13.533691 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b562dd10-3077-47af-b1d4-f5a454dd720c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:13.542460 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b562dd10-3077-47af-b1d4-f5a454dd720c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.169928 Jun 21 15:57:13.543680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 205/403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:13 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:13.819415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-963cbe6d-89c4-450a-838e-a977d729b2b3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:13.820330 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-963cbe6d-89c4-450a-838e-a977d729b2b3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:13.827021 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-963cbe6d-89c4-450a-838e-a977d729b2b3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:13.827666 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-963cbe6d-89c4-450a-838e-a977d729b2b3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:13.828226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-963cbe6d-89c4-450a-838e-a977d729b2b3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:13.828633 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-963cbe6d-89c4-450a-838e-a977d729b2b3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:13.965237 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-963cbe6d-89c4-450a-838e-a977d729b2b3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:13.974652 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-963cbe6d-89c4-450a-838e-a977d729b2b3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.159307 Jun 21 15:57:13.976009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 206/404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:13 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:14.561053 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e4d19402-0d34-4bc4-8444-a1fd05542a6d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:14.561565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e4d19402-0d34-4bc4-8444-a1fd05542a6d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:14.568350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e4d19402-0d34-4bc4-8444-a1fd05542a6d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:14.568796 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e4d19402-0d34-4bc4-8444-a1fd05542a6d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:14.569593 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e4d19402-0d34-4bc4-8444-a1fd05542a6d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:14.570072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e4d19402-0d34-4bc4-8444-a1fd05542a6d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:14.710156 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e4d19402-0d34-4bc4-8444-a1fd05542a6d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:14.718368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e4d19402-0d34-4bc4-8444-a1fd05542a6d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.161364 Jun 21 15:57:14.718952 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 207/405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:14 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:14.993633 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8ff22d0a-320e-463f-9042-c4b750046f24 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:14.994358 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8ff22d0a-320e-463f-9042-c4b750046f24 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:15.001197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8ff22d0a-320e-463f-9042-c4b750046f24 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:15.001632 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8ff22d0a-320e-463f-9042-c4b750046f24 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:15.002421 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8ff22d0a-320e-463f-9042-c4b750046f24 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:15.002877 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8ff22d0a-320e-463f-9042-c4b750046f24 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:15.149804 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8ff22d0a-320e-463f-9042-c4b750046f24 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:15.158349 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8ff22d0a-320e-463f-9042-c4b750046f24 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.169071 Jun 21 15:57:15.159159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 208/406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:14 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:15.736028 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-59efeebc-491d-460e-890b-9c91fb20712a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:15.736628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-59efeebc-491d-460e-890b-9c91fb20712a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:15.743526 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59efeebc-491d-460e-890b-9c91fb20712a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:15.743974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59efeebc-491d-460e-890b-9c91fb20712a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:15.744742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59efeebc-491d-460e-890b-9c91fb20712a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:15.745162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59efeebc-491d-460e-890b-9c91fb20712a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:15.888115 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-59efeebc-491d-460e-890b-9c91fb20712a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:15.899725 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-59efeebc-491d-460e-890b-9c91fb20712a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.167282 Jun 21 15:57:15.900483 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 209/407] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:15 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:16.176292 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-645884d0-5603-4f24-94cc-80c4d3038fe5 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:16.176984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-645884d0-5603-4f24-94cc-80c4d3038fe5 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:16.184310 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-645884d0-5603-4f24-94cc-80c4d3038fe5 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:16.184758 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-645884d0-5603-4f24-94cc-80c4d3038fe5 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:16.185525 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-645884d0-5603-4f24-94cc-80c4d3038fe5 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:16.186007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-645884d0-5603-4f24-94cc-80c4d3038fe5 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:16.324441 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-645884d0-5603-4f24-94cc-80c4d3038fe5 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:16.332685 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-645884d0-5603-4f24-94cc-80c4d3038fe5 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.160442 Jun 21 15:57:16.333370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 210/408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:16 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:16.917383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4b4b44f9-8d85-49ce-b5ed-ce55f7cc2e73 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:16.918016 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4b4b44f9-8d85-49ce-b5ed-ce55f7cc2e73 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:16.919928 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:16.925547 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4b4b44f9-8d85-49ce-b5ed-ce55f7cc2e73 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:16.926009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4b4b44f9-8d85-49ce-b5ed-ce55f7cc2e73 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:16.926756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4b4b44f9-8d85-49ce-b5ed-ce55f7cc2e73 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:16.927176 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4b4b44f9-8d85-49ce-b5ed-ce55f7cc2e73 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:17.072613 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4b4b44f9-8d85-49ce-b5ed-ce55f7cc2e73 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:17.080665 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4b4b44f9-8d85-49ce-b5ed-ce55f7cc2e73 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.167600 Jun 21 15:57:17.081205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 211/409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:16 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:17.351481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-589f1f60-63c2-4bf3-a75a-9e63192e1d5f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:17.352123 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-589f1f60-63c2-4bf3-a75a-9e63192e1d5f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:17.358777 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-589f1f60-63c2-4bf3-a75a-9e63192e1d5f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:17.359226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-589f1f60-63c2-4bf3-a75a-9e63192e1d5f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:17.359973 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-589f1f60-63c2-4bf3-a75a-9e63192e1d5f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:17.360397 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-589f1f60-63c2-4bf3-a75a-9e63192e1d5f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:17.515997 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-589f1f60-63c2-4bf3-a75a-9e63192e1d5f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:17.524705 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-589f1f60-63c2-4bf3-a75a-9e63192e1d5f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.177931 Jun 21 15:57:17.525273 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 212/410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:17 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:18.099623 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-23267496-8d59-4258-8b2c-64fdf0d096bf tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:18.099993 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-23267496-8d59-4258-8b2c-64fdf0d096bf tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:18.106950 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-23267496-8d59-4258-8b2c-64fdf0d096bf tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:18.107397 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-23267496-8d59-4258-8b2c-64fdf0d096bf tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:18.108297 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-23267496-8d59-4258-8b2c-64fdf0d096bf tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:18.108726 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-23267496-8d59-4258-8b2c-64fdf0d096bf tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:18.252650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-23267496-8d59-4258-8b2c-64fdf0d096bf tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:18.261078 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-23267496-8d59-4258-8b2c-64fdf0d096bf tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.166782 Jun 21 15:57:18.261658 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 213/411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:18 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:18.551363 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dd1ce7a6-b3da-47d5-9e1f-7073a236e06c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:18.552517 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dd1ce7a6-b3da-47d5-9e1f-7073a236e06c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:18.561469 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd1ce7a6-b3da-47d5-9e1f-7073a236e06c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:18.561955 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd1ce7a6-b3da-47d5-9e1f-7073a236e06c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:18.562722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd1ce7a6-b3da-47d5-9e1f-7073a236e06c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:18.563173 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd1ce7a6-b3da-47d5-9e1f-7073a236e06c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:18.716405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dd1ce7a6-b3da-47d5-9e1f-7073a236e06c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:18.727843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dd1ce7a6-b3da-47d5-9e1f-7073a236e06c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.184445 Jun 21 15:57:18.728390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 214/412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:18 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:19.280484 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9cef31d7-1c48-4aaa-8619-ee447dcb8ff1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:19.281004 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9cef31d7-1c48-4aaa-8619-ee447dcb8ff1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:19.293295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9cef31d7-1c48-4aaa-8619-ee447dcb8ff1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:19.293730 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9cef31d7-1c48-4aaa-8619-ee447dcb8ff1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:19.294614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9cef31d7-1c48-4aaa-8619-ee447dcb8ff1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:19.295057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9cef31d7-1c48-4aaa-8619-ee447dcb8ff1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:19.313832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ca8a3a63-f4a4-41bb-83cf-e5ec06f3f158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "POST /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.483590 Jun 21 15:57:19.319738 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 199/413] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 15:57:10 2022] POST /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d/os-volume_attachments => generated 194 bytes in 8490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:19.445496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9cef31d7-1c48-4aaa-8619-ee447dcb8ff1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:19.448497 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:19.455406 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9cef31d7-1c48-4aaa-8619-ee447dcb8ff1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.180157 Jun 21 15:57:19.455982 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 215/414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:19 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:19.746679 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-772bf7b6-6620-4af0-a680-311bb0a250dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:19.748149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-772bf7b6-6620-4af0-a680-311bb0a250dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:19.754987 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-772bf7b6-6620-4af0-a680-311bb0a250dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:19.755528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-772bf7b6-6620-4af0-a680-311bb0a250dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:19.756409 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-772bf7b6-6620-4af0-a680-311bb0a250dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:19.756946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-772bf7b6-6620-4af0-a680-311bb0a250dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:19.911940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-772bf7b6-6620-4af0-a680-311bb0a250dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:19.920176 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-772bf7b6-6620-4af0-a680-311bb0a250dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.178594 Jun 21 15:57:19.929584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 200/415] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:19 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:20.075720 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-c1a074e3-6888-42d2-92b2-a48c229e35e4 req-67aa9036-50e4-4704-86da-11840c500add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b86eef-f566-4e16-bcb1-779a14e4ec90", "tag": "e2a0a9e4-f360-48ee-8bfa-9a53de846467"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:20.084486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-c1a074e3-6888-42d2-92b2-a48c229e35e4 req-67aa9036-50e4-4704-86da-11840c500add service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:20.084924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-c1a074e3-6888-42d2-92b2-a48c229e35e4 req-67aa9036-50e4-4704-86da-11840c500add service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:20.099176 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-c1a074e3-6888-42d2-92b2-a48c229e35e4 req-67aa9036-50e4-4704-86da-11840c500add service nova] Creating event network-changed:e2a0a9e4-f360-48ee-8bfa-9a53de846467 for instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 on hv-cinder-84067 Jun 21 15:57:20.107134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-c1a074e3-6888-42d2-92b2-a48c229e35e4 req-67aa9036-50e4-4704-86da-11840c500add service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035458 Jun 21 15:57:20.108040 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 216/416] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:20.472828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2d9231e5-c54e-42f5-84e2-dff73bc5d961 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:20.473846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2d9231e5-c54e-42f5-84e2-dff73bc5d961 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:20.480663 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d9231e5-c54e-42f5-84e2-dff73bc5d961 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:20.481187 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d9231e5-c54e-42f5-84e2-dff73bc5d961 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:20.481988 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d9231e5-c54e-42f5-84e2-dff73bc5d961 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:20.482421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d9231e5-c54e-42f5-84e2-dff73bc5d961 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:20.623719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2d9231e5-c54e-42f5-84e2-dff73bc5d961 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:20.631804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2d9231e5-c54e-42f5-84e2-dff73bc5d961 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.163128 Jun 21 15:57:20.632870 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 201/417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:20 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:20.938106 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d675016b-aa1b-4fc6-a73b-baea8c927062 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:20.938704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d675016b-aa1b-4fc6-a73b-baea8c927062 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:20.945606 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d675016b-aa1b-4fc6-a73b-baea8c927062 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:20.946251 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d675016b-aa1b-4fc6-a73b-baea8c927062 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:20.947021 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d675016b-aa1b-4fc6-a73b-baea8c927062 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:20.947451 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d675016b-aa1b-4fc6-a73b-baea8c927062 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:21.094867 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d675016b-aa1b-4fc6-a73b-baea8c927062 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:21.106741 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d675016b-aa1b-4fc6-a73b-baea8c927062 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.172891 Jun 21 15:57:21.107649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 217/418] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:20 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:21.652928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-12375e35-222b-49c2-ad0c-98b21eea56f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:21.653534 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-12375e35-222b-49c2-ad0c-98b21eea56f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:21.660620 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-12375e35-222b-49c2-ad0c-98b21eea56f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:21.661055 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-12375e35-222b-49c2-ad0c-98b21eea56f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:21.661807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-12375e35-222b-49c2-ad0c-98b21eea56f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:21.662302 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-12375e35-222b-49c2-ad0c-98b21eea56f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:21.830158 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-12375e35-222b-49c2-ad0c-98b21eea56f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:21.838024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-12375e35-222b-49c2-ad0c-98b21eea56f7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.189145 Jun 21 15:57:21.838607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 202/419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:21 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:22.129070 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-38736bae-b6ef-4c4f-a323-7f315bdc8664 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:22.129639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-38736bae-b6ef-4c4f-a323-7f315bdc8664 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:22.138459 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-38736bae-b6ef-4c4f-a323-7f315bdc8664 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:22.138893 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-38736bae-b6ef-4c4f-a323-7f315bdc8664 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:22.139669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-38736bae-b6ef-4c4f-a323-7f315bdc8664 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:22.140088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-38736bae-b6ef-4c4f-a323-7f315bdc8664 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:22.289090 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-38736bae-b6ef-4c4f-a323-7f315bdc8664 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:22.297390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-38736bae-b6ef-4c4f-a323-7f315bdc8664 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.172965 Jun 21 15:57:22.297992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 218/420] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:22 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:22.856475 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-18e95deb-2d11-4630-82b6-49784a6b06dc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:22.857083 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-18e95deb-2d11-4630-82b6-49784a6b06dc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:22.864130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-18e95deb-2d11-4630-82b6-49784a6b06dc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:22.864583 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-18e95deb-2d11-4630-82b6-49784a6b06dc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:22.865335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-18e95deb-2d11-4630-82b6-49784a6b06dc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:22.865762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-18e95deb-2d11-4630-82b6-49784a6b06dc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:23.003304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-18e95deb-2d11-4630-82b6-49784a6b06dc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:23.011410 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-18e95deb-2d11-4630-82b6-49784a6b06dc tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.158847 Jun 21 15:57:23.012251 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 203/421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:22 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:23.318348 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e43e7e0a-0bb4-41c5-b0b1-74f9bbb2ad18 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:23.318957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e43e7e0a-0bb4-41c5-b0b1-74f9bbb2ad18 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:23.325898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e43e7e0a-0bb4-41c5-b0b1-74f9bbb2ad18 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:23.326364 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e43e7e0a-0bb4-41c5-b0b1-74f9bbb2ad18 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:23.327091 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e43e7e0a-0bb4-41c5-b0b1-74f9bbb2ad18 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:23.327519 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e43e7e0a-0bb4-41c5-b0b1-74f9bbb2ad18 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:23.481514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e43e7e0a-0bb4-41c5-b0b1-74f9bbb2ad18 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:23.489596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e43e7e0a-0bb4-41c5-b0b1-74f9bbb2ad18 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.175103 Jun 21 15:57:23.490164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 219/422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:23 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:24.034971 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4cc3c85e-e7c0-4af0-9dda-74f383013aff tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:24.035661 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4cc3c85e-e7c0-4af0-9dda-74f383013aff tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:24.044432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4cc3c85e-e7c0-4af0-9dda-74f383013aff tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:24.044861 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4cc3c85e-e7c0-4af0-9dda-74f383013aff tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:24.045624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4cc3c85e-e7c0-4af0-9dda-74f383013aff tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:24.046093 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4cc3c85e-e7c0-4af0-9dda-74f383013aff tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:24.181524 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4cc3c85e-e7c0-4af0-9dda-74f383013aff tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:24.192153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4cc3c85e-e7c0-4af0-9dda-74f383013aff tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.161083 Jun 21 15:57:24.192689 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 204/423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:24 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:24.508311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f74ad9c6-6a1c-4751-81d6-57cdbea382f2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:24.508922 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f74ad9c6-6a1c-4751-81d6-57cdbea382f2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:24.516187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f74ad9c6-6a1c-4751-81d6-57cdbea382f2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:24.516689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f74ad9c6-6a1c-4751-81d6-57cdbea382f2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:24.517452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f74ad9c6-6a1c-4751-81d6-57cdbea382f2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:24.517963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f74ad9c6-6a1c-4751-81d6-57cdbea382f2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:24.658777 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f74ad9c6-6a1c-4751-81d6-57cdbea382f2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:24.673461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f74ad9c6-6a1c-4751-81d6-57cdbea382f2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.169255 Jun 21 15:57:24.674466 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 220/424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:24 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:24.681200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4b8b002d-92f9-47d0-a50b-a5c8a8b04d71 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:24.682180 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4b8b002d-92f9-47d0-a50b-a5c8a8b04d71 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:24.689015 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4b8b002d-92f9-47d0-a50b-a5c8a8b04d71 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:24.689488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4b8b002d-92f9-47d0-a50b-a5c8a8b04d71 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:24.690436 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4b8b002d-92f9-47d0-a50b-a5c8a8b04d71 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:24.690872 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4b8b002d-92f9-47d0-a50b-a5c8a8b04d71 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:24.714605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4b8b002d-92f9-47d0-a50b-a5c8a8b04d71 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/ips" status: 200 len: 151 microversion: 2.20 time: 0.037707 Jun 21 15:57:24.715188 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 205/425] 10.222.0.52 () {60 vars in 1288 bytes} [Tue Jun 21 15:57:24 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:57:25.212784 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5672a16f-c06b-4ecc-8dca-657b450d381e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:25.213568 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5672a16f-c06b-4ecc-8dca-657b450d381e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:25.223591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5672a16f-c06b-4ecc-8dca-657b450d381e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:25.224196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5672a16f-c06b-4ecc-8dca-657b450d381e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:25.225361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5672a16f-c06b-4ecc-8dca-657b450d381e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:25.226064 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5672a16f-c06b-4ecc-8dca-657b450d381e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:25.378960 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5672a16f-c06b-4ecc-8dca-657b450d381e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:25.388184 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5672a16f-c06b-4ecc-8dca-657b450d381e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.181405 Jun 21 15:57:25.388773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 221/426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:25 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:25.692746 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d1edd8ff-6e93-4f86-a027-93e60cf5b2ac tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:25.693437 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d1edd8ff-6e93-4f86-a027-93e60cf5b2ac tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:25.701982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1edd8ff-6e93-4f86-a027-93e60cf5b2ac tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:25.702302 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1edd8ff-6e93-4f86-a027-93e60cf5b2ac tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:25.703466 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1edd8ff-6e93-4f86-a027-93e60cf5b2ac tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:25.704079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1edd8ff-6e93-4f86-a027-93e60cf5b2ac tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:25.848277 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d1edd8ff-6e93-4f86-a027-93e60cf5b2ac tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:25.856420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d1edd8ff-6e93-4f86-a027-93e60cf5b2ac tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.168009 Jun 21 15:57:25.857019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 206/427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:25 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:26.409060 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-771716b5-7fd6-44d8-b7e3-14d6955eab07 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:26.409757 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-771716b5-7fd6-44d8-b7e3-14d6955eab07 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:26.417378 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-771716b5-7fd6-44d8-b7e3-14d6955eab07 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:26.417829 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-771716b5-7fd6-44d8-b7e3-14d6955eab07 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:26.418595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-771716b5-7fd6-44d8-b7e3-14d6955eab07 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:26.419014 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-771716b5-7fd6-44d8-b7e3-14d6955eab07 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:26.555978 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-771716b5-7fd6-44d8-b7e3-14d6955eab07 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:26.564553 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-771716b5-7fd6-44d8-b7e3-14d6955eab07 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.159688 Jun 21 15:57:26.565158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 222/428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:26 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:26.702138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8ca586dc-3052-499e-8523-bdbf24bf3def tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:26.702732 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8ca586dc-3052-499e-8523-bdbf24bf3def tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:26.709639 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8ca586dc-3052-499e-8523-bdbf24bf3def tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:26.710123 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8ca586dc-3052-499e-8523-bdbf24bf3def tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:26.710868 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8ca586dc-3052-499e-8523-bdbf24bf3def tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:26.711296 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8ca586dc-3052-499e-8523-bdbf24bf3def tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:26.735102 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-8ca586dc-3052-499e-8523-bdbf24bf3def tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lazy-loading 'flavor' on Instance uuid 899aef0a-2cf7-47b2-9b08-0068bde58dae {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 15:57:26.874955 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0aaf4e2b-ef24-417f-9fe4-6e11edfd8d15 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:26.875923 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0aaf4e2b-ef24-417f-9fe4-6e11edfd8d15 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:26.882825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0aaf4e2b-ef24-417f-9fe4-6e11edfd8d15 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:26.883283 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0aaf4e2b-ef24-417f-9fe4-6e11edfd8d15 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:26.884039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0aaf4e2b-ef24-417f-9fe4-6e11edfd8d15 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:26.884461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0aaf4e2b-ef24-417f-9fe4-6e11edfd8d15 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.044468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8ca586dc-3052-499e-8523-bdbf24bf3def tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/action" status: 202 len: 0 microversion: 2.20 time: 0.345899 Jun 21 15:57:27.045703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 207/429] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jun 21 15:57:26 2022] POST /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 15:57:27.062804 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0aaf4e2b-ef24-417f-9fe4-6e11edfd8d15 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:27.069962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:27.070928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:27.072472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0aaf4e2b-ef24-417f-9fe4-6e11edfd8d15 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.201363 Jun 21 15:57:27.073184 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 223/430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:26 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:27.084258 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.085099 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.086016 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.086603 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.128005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-96c0860a-0b2e-4f99-93bb-282a4de8fda4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:27.129109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-96c0860a-0b2e-4f99-93bb-282a4de8fda4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:27.142891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-96c0860a-0b2e-4f99-93bb-282a4de8fda4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.143495 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-96c0860a-0b2e-4f99-93bb-282a4de8fda4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.144375 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-96c0860a-0b2e-4f99-93bb-282a4de8fda4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.145243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-96c0860a-0b2e-4f99-93bb-282a4de8fda4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.179659 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-96c0860a-0b2e-4f99-93bb-282a4de8fda4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/ips" status: 200 len: 145 microversion: 2.1 time: 0.060129 Jun 21 15:57:27.187635 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 224/431] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 15:57:27 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/ips => generated 145 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:27.194051 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-ef8af622-286d-4f41-9a03-bea41fbff8fe req-f6879a99-f0ee-42ac-95e0-efac42a1d272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b86eef-f566-4e16-bcb1-779a14e4ec90", "name": "network-vif-plugged", "status": "completed", "tag": "e2a0a9e4-f360-48ee-8bfa-9a53de846467"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:27.204165 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-ef8af622-286d-4f41-9a03-bea41fbff8fe req-f6879a99-f0ee-42ac-95e0-efac42a1d272 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.204766 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-ef8af622-286d-4f41-9a03-bea41fbff8fe req-f6879a99-f0ee-42ac-95e0-efac42a1d272 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.218002 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-ef8af622-286d-4f41-9a03-bea41fbff8fe req-f6879a99-f0ee-42ac-95e0-efac42a1d272 service nova] Creating event network-vif-plugged:e2a0a9e4-f360-48ee-8bfa-9a53de846467 for instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 on hv-cinder-84067 Jun 21 15:57:27.224073 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-ef8af622-286d-4f41-9a03-bea41fbff8fe req-f6879a99-f0ee-42ac-95e0-efac42a1d272 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034763 Jun 21 15:57:27.224704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 225/432] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:27.266010 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:27.276353 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:27.277871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:27.279094 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b55b010d-3a46-41ab-b805-d3a9677ac6da tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.216166 Jun 21 15:57:27.279654 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 208/433] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:27 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:27.584365 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7cacfb8b-94cf-48c7-8a6b-d605c7af388d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:27.585063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7cacfb8b-94cf-48c7-8a6b-d605c7af388d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:27.591716 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7cacfb8b-94cf-48c7-8a6b-d605c7af388d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.592168 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7cacfb8b-94cf-48c7-8a6b-d605c7af388d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.592932 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7cacfb8b-94cf-48c7-8a6b-d605c7af388d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.593366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7cacfb8b-94cf-48c7-8a6b-d605c7af388d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.695911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b1ecdc8d-5750-4286-951b-f383445fc587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:27.696162 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b1ecdc8d-5750-4286-951b-f383445fc587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:27.704161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b1ecdc8d-5750-4286-951b-f383445fc587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.705013 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b1ecdc8d-5750-4286-951b-f383445fc587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.705400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b1ecdc8d-5750-4286-951b-f383445fc587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:27.705838 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b1ecdc8d-5750-4286-951b-f383445fc587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:27.731901 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b1ecdc8d-5750-4286-951b-f383445fc587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.039163 Jun 21 15:57:27.732520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 209/434] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 15:57:27 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:27.733692 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7cacfb8b-94cf-48c7-8a6b-d605c7af388d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:27.741411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7cacfb8b-94cf-48c7-8a6b-d605c7af388d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.161939 Jun 21 15:57:27.742004 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 226/435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:27 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:28.090386 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-eed78dc2-41b7-44a4-9b0f-88c129aadaf6 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:28.091211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-eed78dc2-41b7-44a4-9b0f-88c129aadaf6 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:28.097543 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:28.136222 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eed78dc2-41b7-44a4-9b0f-88c129aadaf6 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:28.136960 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eed78dc2-41b7-44a4-9b0f-88c129aadaf6 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:28.137950 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eed78dc2-41b7-44a4-9b0f-88c129aadaf6 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:28.138409 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eed78dc2-41b7-44a4-9b0f-88c129aadaf6 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:28.298796 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:28.299468 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:28.308187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:28.308940 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:28.310308 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:28.311046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:28.313252 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-eed78dc2-41b7-44a4-9b0f-88c129aadaf6 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:28.325231 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-eed78dc2-41b7-44a4-9b0f-88c129aadaf6 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.239377 Jun 21 15:57:28.326517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 210/436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:28 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:28.456085 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:28.464211 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:28.465817 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:28.466971 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6a00a85a-6148-40fb-988c-7f7fd5e9de79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.172881 Jun 21 15:57:28.467548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 227/437] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:28 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:28.759515 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0c557e96-eaa7-4b34-a54c-b1a322246d5f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:28.760111 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0c557e96-eaa7-4b34-a54c-b1a322246d5f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:28.767820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c557e96-eaa7-4b34-a54c-b1a322246d5f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:28.768287 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c557e96-eaa7-4b34-a54c-b1a322246d5f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:28.769137 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c557e96-eaa7-4b34-a54c-b1a322246d5f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:28.769620 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c557e96-eaa7-4b34-a54c-b1a322246d5f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:28.903670 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0c557e96-eaa7-4b34-a54c-b1a322246d5f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:28.911513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0c557e96-eaa7-4b34-a54c-b1a322246d5f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.156472 Jun 21 15:57:28.912148 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 211/438] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:28 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:29.349009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4fb52c5a-585f-410e-9aa0-8c8f140fe030 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:29.350005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4fb52c5a-585f-410e-9aa0-8c8f140fe030 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:29.359650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4fb52c5a-585f-410e-9aa0-8c8f140fe030 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:29.360192 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4fb52c5a-585f-410e-9aa0-8c8f140fe030 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:29.361016 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4fb52c5a-585f-410e-9aa0-8c8f140fe030 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:29.361606 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4fb52c5a-585f-410e-9aa0-8c8f140fe030 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:29.485889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:29.486491 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:29.493099 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:29.493545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:29.494737 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:29.495239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:29.513010 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4fb52c5a-585f-410e-9aa0-8c8f140fe030 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:29.520908 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4fb52c5a-585f-410e-9aa0-8c8f140fe030 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.177438 Jun 21 15:57:29.521463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 228/439] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:29 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:29.633150 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:29.637147 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:29.642942 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:29.644418 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:29.645637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5d815773-32a0-4bf4-bfaf-75fa9f2fbd02 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.163755 Jun 21 15:57:29.646249 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 212/440] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:29 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:57:29.934699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c889fb82-9690-4558-9a23-35622c78acc0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:29.935195 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c889fb82-9690-4558-9a23-35622c78acc0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:29.941813 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c889fb82-9690-4558-9a23-35622c78acc0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:29.942289 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c889fb82-9690-4558-9a23-35622c78acc0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:29.943054 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c889fb82-9690-4558-9a23-35622c78acc0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:29.943481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c889fb82-9690-4558-9a23-35622c78acc0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:30.078089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c889fb82-9690-4558-9a23-35622c78acc0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:30.085810 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c889fb82-9690-4558-9a23-35622c78acc0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.155249 Jun 21 15:57:30.086415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 229/441] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:29 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:30.538461 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-be596f37-e81d-4bb6-b5b5-90985c5b519c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:30.539019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-be596f37-e81d-4bb6-b5b5-90985c5b519c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:30.547196 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-be596f37-e81d-4bb6-b5b5-90985c5b519c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:30.547633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-be596f37-e81d-4bb6-b5b5-90985c5b519c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:30.548394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-be596f37-e81d-4bb6-b5b5-90985c5b519c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:30.548817 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-be596f37-e81d-4bb6-b5b5-90985c5b519c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:30.664617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:30.665219 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:30.672109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:30.672561 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:30.673321 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:30.673743 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:30.689117 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-be596f37-e81d-4bb6-b5b5-90985c5b519c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:30.697443 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-be596f37-e81d-4bb6-b5b5-90985c5b519c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.162698 Jun 21 15:57:30.698124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 213/442] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:30 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:30.810023 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:30.819063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:30.820586 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:30.821921 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-692d7832-1cc2-4183-811b-f6f811d1167e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.161143 Jun 21 15:57:30.822462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 230/443] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:30 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:31.103928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-27d5804d-3c43-4c50-be6e-6f597824aa38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:31.104449 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-27d5804d-3c43-4c50-be6e-6f597824aa38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:31.111047 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-27d5804d-3c43-4c50-be6e-6f597824aa38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:31.111488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-27d5804d-3c43-4c50-be6e-6f597824aa38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:31.112248 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-27d5804d-3c43-4c50-be6e-6f597824aa38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:31.112714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-27d5804d-3c43-4c50-be6e-6f597824aa38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:31.253440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-27d5804d-3c43-4c50-be6e-6f597824aa38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:31.261740 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-27d5804d-3c43-4c50-be6e-6f597824aa38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.162050 Jun 21 15:57:31.262359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 214/444] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:31 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:31.715428 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e0d96e7f-1a7d-4e88-9ffa-927713b56c51 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:31.716000 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e0d96e7f-1a7d-4e88-9ffa-927713b56c51 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:31.724243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e0d96e7f-1a7d-4e88-9ffa-927713b56c51 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:31.724694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e0d96e7f-1a7d-4e88-9ffa-927713b56c51 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:31.725470 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e0d96e7f-1a7d-4e88-9ffa-927713b56c51 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:31.725927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e0d96e7f-1a7d-4e88-9ffa-927713b56c51 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:31.841401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:31.842056 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:31.849883 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:31.850351 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:31.851115 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:31.851541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:31.863000 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e0d96e7f-1a7d-4e88-9ffa-927713b56c51 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:31.871935 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e0d96e7f-1a7d-4e88-9ffa-927713b56c51 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.160642 Jun 21 15:57:31.873245 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 231/445] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:31 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:31.996522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:32.008419 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:32.010357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:32.012002 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0b210c7a-b603-4a3a-9527-49cc89e74a1a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.174836 Jun 21 15:57:32.012546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 215/446] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:31 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:32.279089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fa9e1c94-f287-45c2-acc9-b2a848c42ca3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:32.279711 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fa9e1c94-f287-45c2-acc9-b2a848c42ca3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:32.286353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa9e1c94-f287-45c2-acc9-b2a848c42ca3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:32.286818 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa9e1c94-f287-45c2-acc9-b2a848c42ca3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:32.287573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa9e1c94-f287-45c2-acc9-b2a848c42ca3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:32.288007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa9e1c94-f287-45c2-acc9-b2a848c42ca3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:32.436286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fa9e1c94-f287-45c2-acc9-b2a848c42ca3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:32.444234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fa9e1c94-f287-45c2-acc9-b2a848c42ca3 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.169469 Jun 21 15:57:32.444796 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 232/447] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:32 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:32.890773 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d1999676-d24b-4805-920f-f0260ca56f60 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:32.891448 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d1999676-d24b-4805-920f-f0260ca56f60 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:32.899788 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1999676-d24b-4805-920f-f0260ca56f60 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:32.900284 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1999676-d24b-4805-920f-f0260ca56f60 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:32.901732 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1999676-d24b-4805-920f-f0260ca56f60 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:32.902189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1999676-d24b-4805-920f-f0260ca56f60 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:33.033524 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:33.034228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:33.040956 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:33.041508 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:33.042834 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:33.043257 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:33.049586 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d1999676-d24b-4805-920f-f0260ca56f60 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:33.057740 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d1999676-d24b-4805-920f-f0260ca56f60 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1358 microversion: 2.1 time: 0.171287 Jun 21 15:57:33.058371 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 216/448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:32 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:33.187825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:33.200440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:33.202015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:33.203189 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-bf5669bb-7631-410f-8e72-38fbffa7831d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.173831 Jun 21 15:57:33.203750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 233/449] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:33 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:33.322848 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1a3eac6f-a9d0-45a8-b775-fa92dd38c1dd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5c8e453-c3a8-48bf-9860-ed699476a7c0"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:33.324255 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1a3eac6f-a9d0-45a8-b775-fa92dd38c1dd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:33.330750 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a3eac6f-a9d0-45a8-b775-fa92dd38c1dd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:33.331201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a3eac6f-a9d0-45a8-b775-fa92dd38c1dd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:33.332368 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a3eac6f-a9d0-45a8-b775-fa92dd38c1dd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:33.332491 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a3eac6f-a9d0-45a8-b775-fa92dd38c1dd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:33.462698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d550d6c2-b13e-4d0f-8461-c93324133ca1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:33.463531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d550d6c2-b13e-4d0f-8461-c93324133ca1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:33.471219 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d550d6c2-b13e-4d0f-8461-c93324133ca1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:33.472655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d550d6c2-b13e-4d0f-8461-c93324133ca1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:33.473750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d550d6c2-b13e-4d0f-8461-c93324133ca1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:33.474438 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d550d6c2-b13e-4d0f-8461-c93324133ca1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:33.479481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:33.684048 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1a3eac6f-a9d0-45a8-b775-fa92dd38c1dd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366690 Jun 21 15:57:33.684670 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 217/450] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 15:57:33 2022] POST /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:33.685543 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d550d6c2-b13e-4d0f-8461-c93324133ca1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:33.693865 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d550d6c2-b13e-4d0f-8461-c93324133ca1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.235600 Jun 21 15:57:33.694431 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 234/451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:33 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:34.077002 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-05ac051a-cf43-4f66-94fa-de7fa4b87023 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:34.077824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-05ac051a-cf43-4f66-94fa-de7fa4b87023 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:34.084295 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-05ac051a-cf43-4f66-94fa-de7fa4b87023 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.084743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-05ac051a-cf43-4f66-94fa-de7fa4b87023 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.085499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-05ac051a-cf43-4f66-94fa-de7fa4b87023 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.085982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-05ac051a-cf43-4f66-94fa-de7fa4b87023 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.223103 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:34.223811 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:34.230855 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.231264 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.232045 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.232468 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.242945 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-05ac051a-cf43-4f66-94fa-de7fa4b87023 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:34.257359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-05ac051a-cf43-4f66-94fa-de7fa4b87023 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1548 microversion: 2.1 time: 0.186043 Jun 21 15:57:34.257982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 218/452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:34 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:34.273672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-04652058-2f03-47ff-8ee6-de33b0f7f1dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:34.274322 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-04652058-2f03-47ff-8ee6-de33b0f7f1dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:34.280828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-04652058-2f03-47ff-8ee6-de33b0f7f1dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.281276 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-04652058-2f03-47ff-8ee6-de33b0f7f1dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.282080 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-04652058-2f03-47ff-8ee6-de33b0f7f1dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.282516 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-04652058-2f03-47ff-8ee6-de33b0f7f1dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.421941 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:34.430841 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:34.432857 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:34.434128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-51541d51-e61f-44c3-89df-eb486d6f1a59 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.215194 Jun 21 15:57:34.434703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 235/453] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:34 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:34.451245 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-04652058-2f03-47ff-8ee6-de33b0f7f1dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:34.462624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-04652058-2f03-47ff-8ee6-de33b0f7f1dc tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1548 microversion: 2.1 time: 0.192367 Jun 21 15:57:34.463332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 219/454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:34 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1548 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:34.479966 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:34.483489 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:34.484255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Searching by: {'deleted': False, 'project_id': '8716150d618c402fbb51a2a042c5ea5b'} {{(pid=123938) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 15:57:34.491352 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.491807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.492597 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.493078 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.603367 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.multi_cell_list [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123938) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 15:57:34.629544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1c802555-9790-45a5-8160-25e24dec0c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eb0b042-8356-409a-b867-96e5908a7a10"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:34.631264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1c802555-9790-45a5-8160-25e24dec0c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:34.639545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c802555-9790-45a5-8160-25e24dec0c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.639891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c802555-9790-45a5-8160-25e24dec0c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.640668 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c802555-9790-45a5-8160-25e24dec0c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.641088 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c802555-9790-45a5-8160-25e24dec0c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.705888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b38e692d-8f4d-43c6-9994-ec80bbe05d95 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229990 Jun 21 15:57:34.706472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 236/455] 10.222.0.52 () {58 vars in 1124 bytes} [Tue Jun 21 15:57:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:34.713014 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cc3ba282-59d9-474a-a48b-0a4fba50a43f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:34.713851 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cc3ba282-59d9-474a-a48b-0a4fba50a43f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:34.720282 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cc3ba282-59d9-474a-a48b-0a4fba50a43f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.720728 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cc3ba282-59d9-474a-a48b-0a4fba50a43f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:34.721508 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cc3ba282-59d9-474a-a48b-0a4fba50a43f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:34.721963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cc3ba282-59d9-474a-a48b-0a4fba50a43f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:35.083838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cc3ba282-59d9-474a-a48b-0a4fba50a43f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:35.093518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cc3ba282-59d9-474a-a48b-0a4fba50a43f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.385720 Jun 21 15:57:35.094121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 237/456] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:34 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:35.098473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6d8bacd3-0f4b-4e67-8a27-cd77f08b449d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:35.099069 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6d8bacd3-0f4b-4e67-8a27-cd77f08b449d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:35.104807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d8bacd3-0f4b-4e67-8a27-cd77f08b449d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:35.105254 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d8bacd3-0f4b-4e67-8a27-cd77f08b449d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:35.106045 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d8bacd3-0f4b-4e67-8a27-cd77f08b449d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:35.106483 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d8bacd3-0f4b-4e67-8a27-cd77f08b449d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:35.238499 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6d8bacd3-0f4b-4e67-8a27-cd77f08b449d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:35.249329 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6d8bacd3-0f4b-4e67-8a27-cd77f08b449d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1548 microversion: 2.1 time: 0.153814 Jun 21 15:57:35.250170 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 238/457] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:35 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:35.452293 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:35.452889 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:35.459286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:35.459723 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:35.460509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:35.460887 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:35.613072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:35.621662 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:35.623271 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:35.624385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dd20a868-68ce-4451-9fbf-ca7546767790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.176054 Jun 21 15:57:35.624954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 239/458] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:35 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:57:36.115154 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0741c001-52a2-459f-a5df-43b816172cc4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:36.116290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0741c001-52a2-459f-a5df-43b816172cc4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:36.124845 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0741c001-52a2-459f-a5df-43b816172cc4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:36.125321 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0741c001-52a2-459f-a5df-43b816172cc4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:36.126133 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0741c001-52a2-459f-a5df-43b816172cc4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:36.126566 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0741c001-52a2-459f-a5df-43b816172cc4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:36.267544 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0741c001-52a2-459f-a5df-43b816172cc4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:36.276383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0741c001-52a2-459f-a5df-43b816172cc4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.167617 Jun 21 15:57:36.277114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 240/459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:36 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:36.643550 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:36.644170 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:36.651194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:36.651724 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:36.652570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:36.653159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:36.794918 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:36.807679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:36.809406 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:36.810611 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0b05b5ff-7f2d-4a99-b73a-cf562c664eeb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.171301 Jun 21 15:57:36.811182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 241/460] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:36 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:57:37.294636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-20a5ee18-6c45-4cf5-8ba3-478141f42b9f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:37.295281 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-20a5ee18-6c45-4cf5-8ba3-478141f42b9f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:37.302294 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20a5ee18-6c45-4cf5-8ba3-478141f42b9f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:37.302734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20a5ee18-6c45-4cf5-8ba3-478141f42b9f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:37.303489 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20a5ee18-6c45-4cf5-8ba3-478141f42b9f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:37.303920 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20a5ee18-6c45-4cf5-8ba3-478141f42b9f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:37.444774 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-20a5ee18-6c45-4cf5-8ba3-478141f42b9f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:37.452891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-20a5ee18-6c45-4cf5-8ba3-478141f42b9f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.162365 Jun 21 15:57:37.453517 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 242/461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:37 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:37.829654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:37.830188 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:37.836718 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:37.837159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:37.838060 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:37.839309 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:37.986832 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:37.995467 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:37.996940 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:37.998127 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f379b552-ecac-4f1e-a353-b47b13730d2f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.172562 Jun 21 15:57:37.998692 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 243/462] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:37 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:38.473976 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d9f5f0aa-85c2-4ea4-aae6-01a4ca0658a5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:38.474649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d9f5f0aa-85c2-4ea4-aae6-01a4ca0658a5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:38.498125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d9f5f0aa-85c2-4ea4-aae6-01a4ca0658a5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:38.498770 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d9f5f0aa-85c2-4ea4-aae6-01a4ca0658a5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:38.501052 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d9f5f0aa-85c2-4ea4-aae6-01a4ca0658a5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:38.501838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d9f5f0aa-85c2-4ea4-aae6-01a4ca0658a5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:38.706361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d9f5f0aa-85c2-4ea4-aae6-01a4ca0658a5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:38.714725 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d9f5f0aa-85c2-4ea4-aae6-01a4ca0658a5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.247342 Jun 21 15:57:38.725298 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 244/463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:38 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:38.743993 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1c802555-9790-45a5-8160-25e24dec0c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.118330 Jun 21 15:57:38.744801 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 220/464] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 15:57:34 2022] POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/os-volume_attachments => generated 194 bytes in 4120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:39.017048 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:39.017624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:39.035655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:39.036161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:39.036967 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:39.037389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:39.181912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:39.192777 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:39.194853 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:39.195780 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8a4d1054-f359-4278-885a-018f3cc6bac7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.182661 Jun 21 15:57:39.205302 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 245/465] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:39 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:39.734942 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d56355df-9d6f-45b3-8513-28204869f282 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:39.735770 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d56355df-9d6f-45b3-8513-28204869f282 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:39.745434 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d56355df-9d6f-45b3-8513-28204869f282 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:39.746212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d56355df-9d6f-45b3-8513-28204869f282 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:39.746859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d56355df-9d6f-45b3-8513-28204869f282 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:39.747269 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d56355df-9d6f-45b3-8513-28204869f282 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:39.895034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d56355df-9d6f-45b3-8513-28204869f282 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:39.903872 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d56355df-9d6f-45b3-8513-28204869f282 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.174738 Jun 21 15:57:39.904616 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 221/466] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:39 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:40.218204 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:40.218781 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:40.228984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:40.229445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:40.231479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:40.231479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:40.382758 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:40.390933 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:40.392427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:40.393591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ad81939c-126b-47f2-8171-52130e9a568d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.182260 Jun 21 15:57:40.394401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 246/467] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:40 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:40.920393 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-42a970bb-33ed-40e0-8fbb-8780c91d4135 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:40.921027 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-42a970bb-33ed-40e0-8fbb-8780c91d4135 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:40.927684 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-42a970bb-33ed-40e0-8fbb-8780c91d4135 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:40.928128 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-42a970bb-33ed-40e0-8fbb-8780c91d4135 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:40.928880 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-42a970bb-33ed-40e0-8fbb-8780c91d4135 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:40.929484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-42a970bb-33ed-40e0-8fbb-8780c91d4135 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:41.057471 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-029a9ad4-f1e7-4428-8f2b-bdab9e9e0bdf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d64c8c4-1519-4b81-8be9-5d8084bcb074"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:41.059156 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-029a9ad4-f1e7-4428-8f2b-bdab9e9e0bdf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:41.065387 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-029a9ad4-f1e7-4428-8f2b-bdab9e9e0bdf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:41.065880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-029a9ad4-f1e7-4428-8f2b-bdab9e9e0bdf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:41.066085 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-42a970bb-33ed-40e0-8fbb-8780c91d4135 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:41.066561 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-029a9ad4-f1e7-4428-8f2b-bdab9e9e0bdf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:41.067009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-029a9ad4-f1e7-4428-8f2b-bdab9e9e0bdf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:41.073747 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-42a970bb-33ed-40e0-8fbb-8780c91d4135 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.157087 Jun 21 15:57:41.074646 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 222/468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:40 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:41.422612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:41.423307 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:41.430472 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:41.430999 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:41.431952 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:41.432426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:41.575728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:41.584702 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:41.586331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:41.587645 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5752fbfc-f6b5-49b4-a2b1-1e6d7fcd8345 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.170772 Jun 21 15:57:41.588266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 223/469] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:41 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:42.091940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7e606aeb-17b4-422f-839e-6eec76397e33 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:42.092928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7e606aeb-17b4-422f-839e-6eec76397e33 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:42.099558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7e606aeb-17b4-422f-839e-6eec76397e33 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:42.099981 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7e606aeb-17b4-422f-839e-6eec76397e33 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:42.100761 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7e606aeb-17b4-422f-839e-6eec76397e33 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:42.101181 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7e606aeb-17b4-422f-839e-6eec76397e33 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:42.251579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7e606aeb-17b4-422f-839e-6eec76397e33 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:42.259466 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7e606aeb-17b4-422f-839e-6eec76397e33 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.171489 Jun 21 15:57:42.260072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 224/470] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:42 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:42.612533 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:42.613518 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:42.625134 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:42.625843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:42.627077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:42.627893 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:42.785464 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:42.796358 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:42.798578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:42.799823 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4f856177-f158-44b3-874f-089acf6b9d99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.194724 Jun 21 15:57:42.800711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 225/471] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:42 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:43.277310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1ce69ae4-4367-4451-abf2-f25d9adfdc65 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:43.277953 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1ce69ae4-4367-4451-abf2-f25d9adfdc65 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:43.284308 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ce69ae4-4367-4451-abf2-f25d9adfdc65 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:43.284673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ce69ae4-4367-4451-abf2-f25d9adfdc65 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:43.286139 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ce69ae4-4367-4451-abf2-f25d9adfdc65 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:43.286139 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ce69ae4-4367-4451-abf2-f25d9adfdc65 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:43.444300 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1ce69ae4-4367-4451-abf2-f25d9adfdc65 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:43.448155 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:43.455336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1ce69ae4-4367-4451-abf2-f25d9adfdc65 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.183162 Jun 21 15:57:43.455924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 226/472] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:43 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:43.822660 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:43.823255 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:43.831141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:43.831583 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:43.832341 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:43.832784 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:43.975139 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:43.987246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:43.989456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:43.991197 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-134e6770-0c5e-4726-b686-15f57f73174b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.172299 Jun 21 15:57:43.991987 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 227/473] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:43 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:44.473219 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-613eb22e-90be-4151-ad74-fdf4215daf45 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:44.474089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-613eb22e-90be-4151-ad74-fdf4215daf45 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:44.480114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-613eb22e-90be-4151-ad74-fdf4215daf45 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:44.480626 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-613eb22e-90be-4151-ad74-fdf4215daf45 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:44.481801 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-613eb22e-90be-4151-ad74-fdf4215daf45 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:44.482266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-613eb22e-90be-4151-ad74-fdf4215daf45 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:44.528546 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:44.623026 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-613eb22e-90be-4151-ad74-fdf4215daf45 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:44.630825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-613eb22e-90be-4151-ad74-fdf4215daf45 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.161649 Jun 21 15:57:44.631411 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 228/474] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:44 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:45.014902 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:45.015584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:45.024010 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:45.024442 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:45.025191 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:45.025612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:45.160601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:45.168996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:45.170801 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:45.171964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9f7eac0f-eb40-4158-b58f-34e0799accab tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.161935 Jun 21 15:57:45.172848 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 229/475] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:45 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:45.651506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-faaf4409-7d7a-4cbd-a8fc-e01bed81508a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:45.652326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-faaf4409-7d7a-4cbd-a8fc-e01bed81508a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:45.662161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-faaf4409-7d7a-4cbd-a8fc-e01bed81508a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:45.662611 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-faaf4409-7d7a-4cbd-a8fc-e01bed81508a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:45.663764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-faaf4409-7d7a-4cbd-a8fc-e01bed81508a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:45.664414 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-faaf4409-7d7a-4cbd-a8fc-e01bed81508a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:45.805456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-faaf4409-7d7a-4cbd-a8fc-e01bed81508a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:45.816143 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-faaf4409-7d7a-4cbd-a8fc-e01bed81508a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.171264 Jun 21 15:57:45.816719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 230/476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:45 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:57:46.190174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:46.190809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:46.198145 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:46.198592 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:46.199713 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:46.199851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:46.259540 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-029a9ad4-f1e7-4428-8f2b-bdab9e9e0bdf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "POST /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.205810 Jun 21 15:57:46.262744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 247/477] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 15:57:41 2022] POST /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments => generated 194 bytes in 5210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:46.366161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:46.375800 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:46.378069 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:46.379727 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-66ff2b8c-e6cd-4dc8-833f-654f48b6e808 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.193788 Jun 21 15:57:46.380500 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 231/478] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:46 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:57:46.834222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-05b3db8b-7706-4840-8d6e-fd3b1f469225 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:46.834905 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-05b3db8b-7706-4840-8d6e-fd3b1f469225 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:46.842873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05b3db8b-7706-4840-8d6e-fd3b1f469225 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:46.843396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05b3db8b-7706-4840-8d6e-fd3b1f469225 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:46.844570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05b3db8b-7706-4840-8d6e-fd3b1f469225 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:46.845197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05b3db8b-7706-4840-8d6e-fd3b1f469225 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:46.988056 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-05b3db8b-7706-4840-8d6e-fd3b1f469225 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:46.996297 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-05b3db8b-7706-4840-8d6e-fd3b1f469225 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.167099 Jun 21 15:57:46.996866 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 248/479] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:46 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:47.401911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:47.402574 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:47.410038 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:47.410359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:47.411298 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:47.411726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:47.554612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:47.562762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:47.564268 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:47.565637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e2d11ad9-1baa-42f8-8d41-db8d247d2409 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.167850 Jun 21 15:57:47.566964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 232/480] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:47 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:48.018356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6f96a394-43aa-4a9b-9074-078fcbd8987a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:48.019416 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6f96a394-43aa-4a9b-9074-078fcbd8987a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:48.022748 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=76 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:48.028437 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6f96a394-43aa-4a9b-9074-078fcbd8987a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.028876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6f96a394-43aa-4a9b-9074-078fcbd8987a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.029630 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6f96a394-43aa-4a9b-9074-078fcbd8987a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.030088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6f96a394-43aa-4a9b-9074-078fcbd8987a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.032906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:48.178337 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6f96a394-43aa-4a9b-9074-078fcbd8987a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:48.190633 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6f96a394-43aa-4a9b-9074-078fcbd8987a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1503 microversion: 2.1 time: 0.179337 Jun 21 15:57:48.191311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 249/481] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:48 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:48.208417 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f43224f-3fa7-43e7-93a4-b58c90329aaa"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:48.209679 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:48.216538 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.216978 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.218117 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.218542 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.242807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] HTTP exception thrown: Cannot 'attach_volume' instance 81775f43-85e6-49c7-9f5c-adeff449bb59 while it is in vm_state rescued Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Request method failure captured: Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: POST /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59/os-volume_attachments HTTP/1.1 Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 74 Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiseoMRZ-FyFa7yln6vEQlzo7lNXs7ArqF6Nvs6bxzqJ6Ojas_BdnGVED-ZosLrOF01Dg-RQtNYXr5b1sKriCfPdGX6ZelPwrEn6hlT8fdUxiZHzr3PnnsiZ40sUlyA2YQWAMoYm0tybTNR-OImRAuw_EbcgDUM_PMxqknDEqxAKLz4M8 Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 15:57:48.244585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8818885318b54ef6858e754d2bc4587c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 01571ac0b01845f78192269cacb23644 Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {"volumeAttachment": {"volumeId": "3f43224f-3fa7-43e7-93a4-b58c90329aaa"}} Jun 21 15:57:48.246212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Cannot 'attach_volume' instance 81775f43-85e6-49c7-9f5c-adeff449bb59 while it is in vm_state rescued Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'server_id': '81775f43-85e6-49c7-9f5c-adeff449bb59', 'body': {'volumeAttachment': {'volumeId': '3f43224f-3fa7-43e7-93a4-b58c90329aaa'}}} Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81775f43-85e6-49c7-9f5c-adeff449bb59 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:57:48.247084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 81775f43-85e6-49c7-9f5c-adeff449bb59 while it is in vm_state rescued Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:57:48.248477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:57:48.249828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:57:48.249828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:57:48.249828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 81775f43-85e6-49c7-9f5c-adeff449bb59 while it is in vm_state rescued Jun 21 15:57:48.249828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 15:57:48.249828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Returning 409 to user: Cannot 'attach_volume' instance 81775f43-85e6-49c7-9f5c-adeff449bb59 while it is in vm_state rescued {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:57:48.249828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ab5af0d2-957d-4522-b0e7-6fa80b40fe39 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042046 Jun 21 15:57:48.249828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 233/482] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 15:57:48 2022] POST /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 21 15:57:48.255928 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fee0ed2f-7baf-47c3-ba2d-ca6aeb03124a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:48.256463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fee0ed2f-7baf-47c3-ba2d-ca6aeb03124a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:48.262880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fee0ed2f-7baf-47c3-ba2d-ca6aeb03124a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.263334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fee0ed2f-7baf-47c3-ba2d-ca6aeb03124a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.264114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fee0ed2f-7baf-47c3-ba2d-ca6aeb03124a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.264543 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fee0ed2f-7baf-47c3-ba2d-ca6aeb03124a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.339899 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fee0ed2f-7baf-47c3-ba2d-ca6aeb03124a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59/action" status: 202 len: 0 microversion: 2.1 time: 0.087986 Jun 21 15:57:48.344113 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 250/483] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 15:57:48 2022] POST /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 15:57:48.349823 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f0a96fb9-ebc4-4a3f-85e7-a79e18d1c6b8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:48.350546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f0a96fb9-ebc4-4a3f-85e7-a79e18d1c6b8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:48.357932 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0a96fb9-ebc4-4a3f-85e7-a79e18d1c6b8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.358382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0a96fb9-ebc4-4a3f-85e7-a79e18d1c6b8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.359151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0a96fb9-ebc4-4a3f-85e7-a79e18d1c6b8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.359568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f0a96fb9-ebc4-4a3f-85e7-a79e18d1c6b8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.563128 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f0a96fb9-ebc4-4a3f-85e7-a79e18d1c6b8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:48.578389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f0a96fb9-ebc4-4a3f-85e7-a79e18d1c6b8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1511 microversion: 2.1 time: 0.232444 Jun 21 15:57:48.591126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:48.593265 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:48.596805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 234/484] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:48 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:48.610583 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.611256 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.612031 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:48.612452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:48.757652 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:48.769914 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:48.771865 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:48.773650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5237c39a-59d7-4de0-94d5-80219098a58b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.190607 Jun 21 15:57:48.774523 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 251/485] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:48 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:57:49.604049 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2f76fd46-4e39-423c-a665-ff98b85ff9ac tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:49.604786 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2f76fd46-4e39-423c-a665-ff98b85ff9ac tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:49.612140 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2f76fd46-4e39-423c-a665-ff98b85ff9ac tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:49.612570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2f76fd46-4e39-423c-a665-ff98b85ff9ac tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:49.613343 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2f76fd46-4e39-423c-a665-ff98b85ff9ac tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:49.613820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2f76fd46-4e39-423c-a665-ff98b85ff9ac tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:49.653206 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-47456885-1045-4999-92cb-b9a4c356be73 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:49.653687 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-47456885-1045-4999-92cb-b9a4c356be73 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:49.661501 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-47456885-1045-4999-92cb-b9a4c356be73 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:49.661957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-47456885-1045-4999-92cb-b9a4c356be73 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:49.662750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-47456885-1045-4999-92cb-b9a4c356be73 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:49.663181 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-47456885-1045-4999-92cb-b9a4c356be73 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:49.761802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2f76fd46-4e39-423c-a665-ff98b85ff9ac tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:49.769357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2f76fd46-4e39-423c-a665-ff98b85ff9ac tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1511 microversion: 2.1 time: 0.170142 Jun 21 15:57:49.769967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 235/486] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:49 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:49.792809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:49.793403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:49.795650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-47456885-1045-4999-92cb-b9a4c356be73 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lazy-loading 'services' on Instance uuid b51b581b-07bc-41e2-9dfb-1db8bf770e8d {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 15:57:49.799681 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:49.800166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:49.800998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:49.801501 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:49.913509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-47456885-1045-4999-92cb-b9a4c356be73 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d/os-volume_attachments/0e5ff6bd-eee8-4617-bfb2-5bb7a473a6c2" status: 202 len: 0 microversion: 2.1 time: 0.264264 Jun 21 15:57:49.914166 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 252/487] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 15:57:49 2022] DELETE /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d/os-volume_attachments/0e5ff6bd-eee8-4617-bfb2-5bb7a473a6c2 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 15:57:49.942380 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:49.952366 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:49.954382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:49.955591 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5e9777ff-0868-480b-a7ca-d93e373ae0b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.166600 Jun 21 15:57:49.956154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 236/488] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:49 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:57:50.789243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-934112e8-5529-4fbb-a8a7-a0102bf413ea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:50.790491 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-934112e8-5529-4fbb-a8a7-a0102bf413ea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:50.801268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-934112e8-5529-4fbb-a8a7-a0102bf413ea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:50.802050 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-934112e8-5529-4fbb-a8a7-a0102bf413ea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:50.803700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-934112e8-5529-4fbb-a8a7-a0102bf413ea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:50.804132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-934112e8-5529-4fbb-a8a7-a0102bf413ea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:50.965225 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-934112e8-5529-4fbb-a8a7-a0102bf413ea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:50.974502 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-934112e8-5529-4fbb-a8a7-a0102bf413ea tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1511 microversion: 2.1 time: 0.191298 Jun 21 15:57:50.975076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 253/489] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:50 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:50.979026 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:50.980026 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:50.987227 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:50.987924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:50.988889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:50.989645 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:51.159951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:51.169744 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:51.171248 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:51.172439 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5df59295-5d8b-4e53-9fc2-25f9ba192892 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.200521 Jun 21 15:57:51.173218 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 237/490] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:50 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:57:51.993689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ea5297ba-dc43-4e1b-bdf6-e85257041406 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:51.994355 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ea5297ba-dc43-4e1b-bdf6-e85257041406 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:52.001336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea5297ba-dc43-4e1b-bdf6-e85257041406 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:52.001803 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea5297ba-dc43-4e1b-bdf6-e85257041406 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:52.002624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea5297ba-dc43-4e1b-bdf6-e85257041406 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:52.003023 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea5297ba-dc43-4e1b-bdf6-e85257041406 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:52.143409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ea5297ba-dc43-4e1b-bdf6-e85257041406 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:52.151554 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ea5297ba-dc43-4e1b-bdf6-e85257041406 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1511 microversion: 2.1 time: 0.162874 Jun 21 15:57:52.152130 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 254/491] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:51 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:52.193469 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:52.194619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:52.201030 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:52.201467 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:52.202272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:52.202696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:52.345347 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:52.356331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:52.357795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:52.358964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8acef7a3-4389-46be-bb50-039711f16467 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.169661 Jun 21 15:57:52.359521 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 238/492] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:52 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:53.169473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-020c14e6-9f14-4369-a44b-6f3d34716c00 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:53.169473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-020c14e6-9f14-4369-a44b-6f3d34716c00 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:53.176220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-020c14e6-9f14-4369-a44b-6f3d34716c00 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:53.176664 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-020c14e6-9f14-4369-a44b-6f3d34716c00 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:53.177422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-020c14e6-9f14-4369-a44b-6f3d34716c00 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:53.177879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-020c14e6-9f14-4369-a44b-6f3d34716c00 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:53.321605 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-020c14e6-9f14-4369-a44b-6f3d34716c00 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:53.330349 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-020c14e6-9f14-4369-a44b-6f3d34716c00 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1517 microversion: 2.1 time: 0.165512 Jun 21 15:57:53.330993 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 255/493] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:53 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:53.377856 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:53.378465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:53.385969 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:53.386398 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:53.387165 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:53.387584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:53.546331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:53.555638 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:53.557343 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:53.558731 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c6735c4a-9fe7-4a2b-bccf-e91ef5153bbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1744 microversion: 2.20 time: 0.184921 Jun 21 15:57:53.559564 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 239/494] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:53 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:54.577538 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:54.578222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:54.585649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:54.586114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:54.586903 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:54.587427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:54.725654 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2b193b25-9d15-4677-af86-4d9b6b6ee70a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'create', calling method: .version_select at 0x7f73b5f01ee0>, body: {"keypair": {"name": "tempest-keypair-1053277185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFpx5dPEp9wKsAYSGfOjCi6ndSpS/bVfEGgFL9j4Eev6ZoGFFy/STGg7s+fSwElbu58ln3HgXLKCWLp+XpO0yU82RDXG+nzkgUHFF4cW+MLXYEzp/jlmDYp77uHLMPY6w=="}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:54.751246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-2b193b25-9d15-4677-af86-4d9b6b6ee70a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Getting quotas for project 8818885318b54ef6858e754d2bc4587c. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:57:54.752500 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:54.759454 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-2b193b25-9d15-4677-af86-4d9b6b6ee70a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Getting quotas for user 01571ac0b01845f78192269cacb23644 and project 8818885318b54ef6858e754d2bc4587c. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:57:54.771481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:54.777179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:54.780127 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5938206e-1409-4d45-89f6-8688ea41ebf3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1744 microversion: 2.20 time: 0.206315 Jun 21 15:57:54.795284 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 256/495] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:54 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:54.803365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2b193b25-9d15-4677-af86-4d9b6b6ee70a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082410 Jun 21 15:57:54.804416 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 240/496] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 15:57:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:57:55.072895 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-57e6ae11-759a-4878-9910-fb170aa28fb4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: .version_select at 0x7f73b610c700>, body: {"keypair": {"name": "tempest-keypair-336204172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1fZR4VkyOhJ/odJE+MnFjAUO5zGithjZ5o8EUc/aASH4qDfu9ywd4y5VRABbknmSz1VHlXRgUhcySPWbbXkwkE/p90xihNu6Sh43xmOSxsHUqDnMtifdO3t5L8foqhEg=="}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:55.087868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-57e6ae11-759a-4878-9910-fb170aa28fb4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for project d20d29454c00499282eb86547eeb4c10. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:57:55.092394 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-57e6ae11-759a-4878-9910-fb170aa28fb4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for user 9a67a5c4b7034d22b78331b907cc20bc and project d20d29454c00499282eb86547eeb4c10. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:57:55.121566 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-57e6ae11-759a-4878-9910-fb170aa28fb4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052681 Jun 21 15:57:55.122760 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 257/497] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 15:57:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:55.199630 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-34a7cd4a-e092-4ba1-8bed-816976c47e6e req-331d4660-621f-43bb-9975-f95e35b54fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899aef0a-2cf7-47b2-9b08-0068bde58dae", "name": "network-vif-plugged", "status": "completed", "tag": "6288bac4-2f2c-42ad-9eca-74ece6209900"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:55.211097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-34a7cd4a-e092-4ba1-8bed-816976c47e6e req-331d4660-621f-43bb-9975-f95e35b54fcc service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:55.211891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-34a7cd4a-e092-4ba1-8bed-816976c47e6e req-331d4660-621f-43bb-9975-f95e35b54fcc service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:55.226184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-34a7cd4a-e092-4ba1-8bed-816976c47e6e req-331d4660-621f-43bb-9975-f95e35b54fcc service nova] Creating event network-vif-plugged:6288bac4-2f2c-42ad-9eca-74ece6209900 for instance 899aef0a-2cf7-47b2-9b08-0068bde58dae on hv-cinder-84067 Jun 21 15:57:55.232489 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-34a7cd4a-e092-4ba1-8bed-816976c47e6e req-331d4660-621f-43bb-9975-f95e35b54fcc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036750 Jun 21 15:57:55.233402 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 241/498] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:57:55.810774 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:55.811463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:55.819639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:55.820166 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:55.820998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:55.822341 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:56.057715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:56.068519 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:56.070541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:56.072130 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d3931d9d-4711-47a3-ac00-60afd4866fd5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1744 microversion: 2.20 time: 0.267568 Jun 21 15:57:56.083390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 258/499] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:55 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1744 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:56.226544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-527568116", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5087213d-7a21-43e5-852a-25ad34dd2ccf"}], "security_groups": [{"name": "tempest-securitygroup--1004381240"}], "key_name": "tempest-keypair-1053277185", "user_data": "}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:56.388150 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] validate_networks() for [('5087213d-7a21-43e5-852a-25ad34dd2ccf', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:57:56.866663 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-581910730", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cdeeb75-9f47-4354-8a71-6e4a191914df"}], "security_groups": [{"name": "tempest-securitygroup--641852978"}], "key_name": "tempest-keypair-336204172", "user_data": "}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:57:56.942804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:57:56.942804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:57:56.942804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:57:56.942804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:57:56.942804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:57:56.949158 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:56.949594 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:56.950477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:56.950900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:56.973010 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Getting quotas for project 8818885318b54ef6858e754d2bc4587c. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:57:56.977041 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Getting quotas for user 01571ac0b01845f78192269cacb23644 and project 8818885318b54ef6858e754d2bc4587c. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:57:56.989362 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:57:56.991914 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:57:56.995803 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] validate_networks() for [('5cdeeb75-9f47-4354-8a71-6e4a191914df', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:57:57.040076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-38b445fd-c8d8-4f0e-8d6d-8dca74c5dd82 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.819513 Jun 21 15:57:57.041069 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 242/500] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:57:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:57:57.051396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d94e28b1-14af-416d-a25e-3ae4389f80db tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:57.051998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d94e28b1-14af-416d-a25e-3ae4389f80db tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:57.120764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d94e28b1-14af-416d-a25e-3ae4389f80db tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:57.128756 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d94e28b1-14af-416d-a25e-3ae4389f80db tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1245 microversion: 2.1 time: 0.081485 Jun 21 15:57:57.129878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 243/501] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:57 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:57.134833 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:57.135627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:57.142174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:57.142612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:57.144114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:57.144545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:57.384909 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:57.394644 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:57.396133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:57.397299 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-10dd08fe-f731-4050-9c27-4a2e6f3d2a33 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1744 microversion: 2.20 time: 0.266338 Jun 21 15:57:57.397870 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 244/502] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:57 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1744 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:57.731496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:57:57.731910 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:57:57.732448 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:57:57.732819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:57:57.733219 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:57:57.743036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:57.743779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:57.744260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:57.744690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:57.761862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for project d20d29454c00499282eb86547eeb4c10. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:57:57.765960 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for user 9a67a5c4b7034d22b78331b907cc20bc and project d20d29454c00499282eb86547eeb4c10. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:57:57.777547 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:57:57.779894 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:57:57.828762 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ea63fab5-d6dd-4e4e-8f43-2c3d0ee6d31f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.966435 Jun 21 15:57:57.829333 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 259/503] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:57:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:57:57.839389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d42a3423-28af-4a60-a9ab-82c1eba8a567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:57.839991 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d42a3423-28af-4a60-a9ab-82c1eba8a567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:57.847223 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:57.903218 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d42a3423-28af-4a60-a9ab-82c1eba8a567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:57.909966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d42a3423-28af-4a60-a9ab-82c1eba8a567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1240 microversion: 2.1 time: 0.074403 Jun 21 15:57:57.910660 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 245/504] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:57 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:58.147240 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4f80174c-a726-4777-9468-fda0be67935d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:58.148295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4f80174c-a726-4777-9468-fda0be67935d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:58.158052 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4f80174c-a726-4777-9468-fda0be67935d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:58.158771 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4f80174c-a726-4777-9468-fda0be67935d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:58.160185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4f80174c-a726-4777-9468-fda0be67935d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:58.161052 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4f80174c-a726-4777-9468-fda0be67935d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:58.243680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4f80174c-a726-4777-9468-fda0be67935d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:58.251618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4f80174c-a726-4777-9468-fda0be67935d tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1315 microversion: 2.1 time: 0.109016 Jun 21 15:57:58.252185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 260/505] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:58 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1315 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:58.416376 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:58.417055 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:58.424060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:58.424732 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:58.425881 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:58.426754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:58.582007 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:58.598354 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:58.601640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:58.601640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2aa47faf-e648-4a3f-b4ca-096a9e91bf3d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1744 microversion: 2.20 time: 0.189682 Jun 21 15:57:58.603920 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 246/506] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:58 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:57:58.929164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1e6d23a0-c115-4d59-8747-2bca66e37515 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:58.930916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1e6d23a0-c115-4d59-8747-2bca66e37515 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:58.943728 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e6d23a0-c115-4d59-8747-2bca66e37515 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:58.944175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e6d23a0-c115-4d59-8747-2bca66e37515 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:58.945266 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e6d23a0-c115-4d59-8747-2bca66e37515 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:58.945712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e6d23a0-c115-4d59-8747-2bca66e37515 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:59.028250 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1e6d23a0-c115-4d59-8747-2bca66e37515 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:59.046613 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1e6d23a0-c115-4d59-8747-2bca66e37515 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1300 microversion: 2.1 time: 0.114986 Jun 21 15:57:59.047409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 261/507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:58 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:59.268880 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b6dfdb3e-25b1-4888-b7a9-7e62d1b912e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:59.269624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b6dfdb3e-25b1-4888-b7a9-7e62d1b912e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:59.291030 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b6dfdb3e-25b1-4888-b7a9-7e62d1b912e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:59.291554 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b6dfdb3e-25b1-4888-b7a9-7e62d1b912e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:59.292585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b6dfdb3e-25b1-4888-b7a9-7e62d1b912e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:59.293262 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b6dfdb3e-25b1-4888-b7a9-7e62d1b912e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:59.424408 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b6dfdb3e-25b1-4888-b7a9-7e62d1b912e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:59.432356 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b6dfdb3e-25b1-4888-b7a9-7e62d1b912e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.167091 Jun 21 15:57:59.432922 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 247/508] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:57:59 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:57:59.620523 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:57:59.621148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:57:59.628382 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:59.628839 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:59.629634 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:57:59.630041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:57:59.772552 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:59.783825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:59.785413 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:57:59.786619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f3340b2d-4627-4651-ad33-f51b0dad0dbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1744 microversion: 2.20 time: 0.170095 Jun 21 15:57:59.787176 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 262/509] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:57:59 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:00.066185 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fb095a03-b53b-4e59-bd98-82e74656f567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:00.067324 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fb095a03-b53b-4e59-bd98-82e74656f567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:00.077100 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fb095a03-b53b-4e59-bd98-82e74656f567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:00.077866 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fb095a03-b53b-4e59-bd98-82e74656f567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:00.079630 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fb095a03-b53b-4e59-bd98-82e74656f567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:00.080464 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fb095a03-b53b-4e59-bd98-82e74656f567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:00.094018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-f1c8375d-f024-4130-8aa0-7017a7ff3c0c req-560957a7-674c-451f-b76a-7662d283aa6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db5afaf8-702b-44ef-bafd-b80903345966", "tag": "d74a9552-5153-4ad9-8130-43325526cc8b"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:00.097085 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:00.113343 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-f1c8375d-f024-4130-8aa0-7017a7ff3c0c req-560957a7-674c-451f-b76a-7662d283aa6e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:00.113948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-f1c8375d-f024-4130-8aa0-7017a7ff3c0c req-560957a7-674c-451f-b76a-7662d283aa6e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:00.130442 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-f1c8375d-f024-4130-8aa0-7017a7ff3c0c req-560957a7-674c-451f-b76a-7662d283aa6e service nova] Creating event network-changed:d74a9552-5153-4ad9-8130-43325526cc8b for instance db5afaf8-702b-44ef-bafd-b80903345966 on hv-cinder-84067 Jun 21 15:58:00.136508 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-f1c8375d-f024-4130-8aa0-7017a7ff3c0c req-560957a7-674c-451f-b76a-7662d283aa6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051816 Jun 21 15:58:00.137756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 263/510] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:00.203201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fb095a03-b53b-4e59-bd98-82e74656f567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:00.222014 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fb095a03-b53b-4e59-bd98-82e74656f567 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1298 microversion: 2.1 time: 0.160744 Jun 21 15:58:00.223680 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 248/511] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:00 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:00.450682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2c56fe10-029e-4445-a9b2-ee4b7546b641 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:00.451376 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2c56fe10-029e-4445-a9b2-ee4b7546b641 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:00.457674 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c56fe10-029e-4445-a9b2-ee4b7546b641 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:00.458146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c56fe10-029e-4445-a9b2-ee4b7546b641 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:00.458898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c56fe10-029e-4445-a9b2-ee4b7546b641 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:00.459323 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c56fe10-029e-4445-a9b2-ee4b7546b641 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:00.605299 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2c56fe10-029e-4445-a9b2-ee4b7546b641 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:00.613896 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2c56fe10-029e-4445-a9b2-ee4b7546b641 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.167780 Jun 21 15:58:00.614472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 264/512] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:00 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:00.804735 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:00.805464 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:00.812634 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:00.813079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:00.813855 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:00.814491 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:00.951889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:00.962916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:00.964448 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:00.965635 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3a32242f-9f2d-4997-8f6d-85db67bf9b64 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1744 microversion: 2.20 time: 0.164883 Jun 21 15:58:00.966543 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 249/513] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:00 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:01.241254 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ae95d57e-0c27-43bf-afa5-581a118c80b0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:01.241947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ae95d57e-0c27-43bf-afa5-581a118c80b0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:01.253817 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ae95d57e-0c27-43bf-afa5-581a118c80b0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:01.254558 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ae95d57e-0c27-43bf-afa5-581a118c80b0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:01.255453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ae95d57e-0c27-43bf-afa5-581a118c80b0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:01.255889 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ae95d57e-0c27-43bf-afa5-581a118c80b0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:01.390789 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ae95d57e-0c27-43bf-afa5-581a118c80b0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:01.398750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ae95d57e-0c27-43bf-afa5-581a118c80b0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.162292 Jun 21 15:58:01.399551 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 265/514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:01 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:01.631181 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-22b261c5-a68e-43a7-9af5-8c0fa9f1be61 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:01.631783 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-22b261c5-a68e-43a7-9af5-8c0fa9f1be61 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:01.638256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-22b261c5-a68e-43a7-9af5-8c0fa9f1be61 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:01.638635 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-22b261c5-a68e-43a7-9af5-8c0fa9f1be61 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:01.639395 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-22b261c5-a68e-43a7-9af5-8c0fa9f1be61 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:01.639836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-22b261c5-a68e-43a7-9af5-8c0fa9f1be61 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:01.770430 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-22b261c5-a68e-43a7-9af5-8c0fa9f1be61 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:01.778361 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-22b261c5-a68e-43a7-9af5-8c0fa9f1be61 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.151075 Jun 21 15:58:01.778891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 250/515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:01 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:01.985260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:01.985901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:01.992177 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:01.992860 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:01.993698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:01.994144 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.010948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:02.175017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:02.175611 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-41bf1f38-4c9d-4a89-8726-be6b3d596e25 req-1b06595d-5f27-40b4-be3b-034b8f50b0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e069614-4aff-4e07-841c-31317d94f447", "tag": "11038423-70d0-440b-b68d-35bfa6a0d923"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:02.184965 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:02.186531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:02.187779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-87988db4-3502-4c3d-8787-c25c8a20b6f5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.207099 Jun 21 15:58:02.188482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 266/516] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:01 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:02.191371 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-41bf1f38-4c9d-4a89-8726-be6b3d596e25 req-1b06595d-5f27-40b4-be3b-034b8f50b0c1 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:02.191812 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-41bf1f38-4c9d-4a89-8726-be6b3d596e25 req-1b06595d-5f27-40b4-be3b-034b8f50b0c1 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.205891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-41bf1f38-4c9d-4a89-8726-be6b3d596e25 req-1b06595d-5f27-40b4-be3b-034b8f50b0c1 service nova] Creating event network-changed:11038423-70d0-440b-b68d-35bfa6a0d923 for instance 8e069614-4aff-4e07-841c-31317d94f447 on hv-cinder-84067 Jun 21 15:58:02.210805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-41bf1f38-4c9d-4a89-8726-be6b3d596e25 req-1b06595d-5f27-40b4-be3b-034b8f50b0c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039300 Jun 21 15:58:02.211881 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 251/517] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:02.415925 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-004f350c-5e7e-439e-b16a-612e480ff4d5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:02.417137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-004f350c-5e7e-439e-b16a-612e480ff4d5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:02.431754 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-004f350c-5e7e-439e-b16a-612e480ff4d5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:02.433472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-004f350c-5e7e-439e-b16a-612e480ff4d5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.434356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-004f350c-5e7e-439e-b16a-612e480ff4d5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:02.434781 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-004f350c-5e7e-439e-b16a-612e480ff4d5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.452245 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2248d989-a7f6-4e39-8d4f-c3536566477f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:02.461043 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2248d989-a7f6-4e39-8d4f-c3536566477f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:02.461538 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2248d989-a7f6-4e39-8d4f-c3536566477f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.557603 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2248d989-a7f6-4e39-8d4f-c3536566477f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Going to try to stop instance {{(pid=123939) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 15:58:02.624708 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2248d989-a7f6-4e39-8d4f-c3536566477f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/action" status: 202 len: 0 microversion: 2.1 time: 0.176515 Jun 21 15:58:02.626576 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-004f350c-5e7e-439e-b16a-612e480ff4d5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:02.633590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 252/518] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 15:58:02 2022] POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 15:58:02.641366 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-91c31a7d-9766-409e-b028-2ec7bf8553b2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:02.642584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-91c31a7d-9766-409e-b028-2ec7bf8553b2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:02.649663 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-004f350c-5e7e-439e-b16a-612e480ff4d5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.236376 Jun 21 15:58:02.650901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 267/519] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:02 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:02.653830 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-91c31a7d-9766-409e-b028-2ec7bf8553b2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:02.654460 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-91c31a7d-9766-409e-b028-2ec7bf8553b2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.655413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-91c31a7d-9766-409e-b028-2ec7bf8553b2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:02.656161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-91c31a7d-9766-409e-b028-2ec7bf8553b2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.795977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-69bccfe1-82af-4516-8959-f0704aeffbec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:02.798726 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-69bccfe1-82af-4516-8959-f0704aeffbec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:02.810112 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-69bccfe1-82af-4516-8959-f0704aeffbec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:02.811428 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-69bccfe1-82af-4516-8959-f0704aeffbec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.814658 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-69bccfe1-82af-4516-8959-f0704aeffbec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:02.815095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-69bccfe1-82af-4516-8959-f0704aeffbec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:02.849373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-91c31a7d-9766-409e-b028-2ec7bf8553b2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:02.860302 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-91c31a7d-9766-409e-b028-2ec7bf8553b2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.223789 Jun 21 15:58:02.877725 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 253/520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:02 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:02.997560 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-69bccfe1-82af-4516-8959-f0704aeffbec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:03.005453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-69bccfe1-82af-4516-8959-f0704aeffbec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.213608 Jun 21 15:58:03.006046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 268/521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:02 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:03.206962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:03.208358 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:03.216488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:03.216924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:03.217696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:03.218135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:03.407899 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:03.419304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:03.421276 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:03.422841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e3d094ce-d54a-4f10-8dfc-9c3107e4809c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.219900 Jun 21 15:58:03.434710 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 254/522] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:03 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:03.667916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c147be1a-fb07-4099-8126-8979978cadcf tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:03.669700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c147be1a-fb07-4099-8126-8979978cadcf tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:03.677791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c147be1a-fb07-4099-8126-8979978cadcf tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:03.678487 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c147be1a-fb07-4099-8126-8979978cadcf tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:03.679503 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c147be1a-fb07-4099-8126-8979978cadcf tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:03.680042 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c147be1a-fb07-4099-8126-8979978cadcf tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:03.863816 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c147be1a-fb07-4099-8126-8979978cadcf tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:03.871629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c147be1a-fb07-4099-8126-8979978cadcf tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.209017 Jun 21 15:58:03.874192 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 269/523] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:03 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:03.879257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a2afbb57-a514-4b90-9692-28b97ec8a6a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:03.880316 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a2afbb57-a514-4b90-9692-28b97ec8a6a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:03.889816 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a2afbb57-a514-4b90-9692-28b97ec8a6a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:03.890565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a2afbb57-a514-4b90-9692-28b97ec8a6a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:03.891582 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a2afbb57-a514-4b90-9692-28b97ec8a6a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:03.892012 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a2afbb57-a514-4b90-9692-28b97ec8a6a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:04.022978 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c352c006-41a1-4e2a-8ef6-65dd1e080901 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:04.024039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c352c006-41a1-4e2a-8ef6-65dd1e080901 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:04.030619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c352c006-41a1-4e2a-8ef6-65dd1e080901 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:04.031632 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c352c006-41a1-4e2a-8ef6-65dd1e080901 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:04.032601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c352c006-41a1-4e2a-8ef6-65dd1e080901 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:04.033029 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c352c006-41a1-4e2a-8ef6-65dd1e080901 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:04.033529 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a2afbb57-a514-4b90-9692-28b97ec8a6a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:04.044193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a2afbb57-a514-4b90-9692-28b97ec8a6a8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.169278 Jun 21 15:58:04.046065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 255/524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:03 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:04.178906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c352c006-41a1-4e2a-8ef6-65dd1e080901 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:04.186947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c352c006-41a1-4e2a-8ef6-65dd1e080901 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.168263 Jun 21 15:58:04.187810 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 270/525] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:04 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:04.444908 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:04.445619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:04.470097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:04.470097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:04.470097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:04.470463 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:04.647673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:04.656830 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:04.658169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:04.659348 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-88b9ae60-6f7c-4878-9b4d-2ec0975e3c93 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.220823 Jun 21 15:58:04.659903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 256/526] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:04 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:04.892122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6468f11f-2023-420b-9c4d-b61a4ab37ac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:04.892939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6468f11f-2023-420b-9c4d-b61a4ab37ac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:04.905543 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6468f11f-2023-420b-9c4d-b61a4ab37ac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:04.906016 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6468f11f-2023-420b-9c4d-b61a4ab37ac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:04.906783 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6468f11f-2023-420b-9c4d-b61a4ab37ac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:04.907240 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6468f11f-2023-420b-9c4d-b61a4ab37ac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:05.067069 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1aa8c1d6-3257-4e8e-80da-c03d2b9f0a21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:05.068056 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1aa8c1d6-3257-4e8e-80da-c03d2b9f0a21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:05.074174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1aa8c1d6-3257-4e8e-80da-c03d2b9f0a21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:05.074512 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1aa8c1d6-3257-4e8e-80da-c03d2b9f0a21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:05.075310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1aa8c1d6-3257-4e8e-80da-c03d2b9f0a21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:05.075687 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1aa8c1d6-3257-4e8e-80da-c03d2b9f0a21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:05.094579 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6468f11f-2023-420b-9c4d-b61a4ab37ac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:05.108385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6468f11f-2023-420b-9c4d-b61a4ab37ac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.220246 Jun 21 15:58:05.108988 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 271/527] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:04 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:05.204080 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-93b9ac3b-c693-4574-a0f8-93fffd9a4208 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:05.205283 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-93b9ac3b-c693-4574-a0f8-93fffd9a4208 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:05.221863 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-93b9ac3b-c693-4574-a0f8-93fffd9a4208 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:05.221863 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-93b9ac3b-c693-4574-a0f8-93fffd9a4208 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:05.221863 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-93b9ac3b-c693-4574-a0f8-93fffd9a4208 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:05.221863 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-93b9ac3b-c693-4574-a0f8-93fffd9a4208 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:05.236443 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1aa8c1d6-3257-4e8e-80da-c03d2b9f0a21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:05.248164 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1aa8c1d6-3257-4e8e-80da-c03d2b9f0a21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.186174 Jun 21 15:58:05.249594 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 257/528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:05 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:05.377306 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-93b9ac3b-c693-4574-a0f8-93fffd9a4208 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:05.390351 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-93b9ac3b-c693-4574-a0f8-93fffd9a4208 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.189994 Jun 21 15:58:05.391750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 272/529] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:05 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:05.678691 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:05.680154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:05.691482 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:05.692314 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:05.694375 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:05.695137 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:05.865420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:05.874572 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:05.876773 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:05.877860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5216b6b1-565d-4960-b862-d0256bc0ec7a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.203193 Jun 21 15:58:05.877966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 258/530] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:05 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:06.133851 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dad2baea-9953-4c43-9fc8-e030471a5082 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:06.134691 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dad2baea-9953-4c43-9fc8-e030471a5082 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:06.144734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dad2baea-9953-4c43-9fc8-e030471a5082 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:06.144734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dad2baea-9953-4c43-9fc8-e030471a5082 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:06.146001 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dad2baea-9953-4c43-9fc8-e030471a5082 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:06.146493 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dad2baea-9953-4c43-9fc8-e030471a5082 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:06.267614 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-96ca3d05-b95a-48dd-8b46-479211360691 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:06.268369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-96ca3d05-b95a-48dd-8b46-479211360691 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:06.278207 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-96ca3d05-b95a-48dd-8b46-479211360691 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:06.278720 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-96ca3d05-b95a-48dd-8b46-479211360691 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:06.279494 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-96ca3d05-b95a-48dd-8b46-479211360691 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:06.279918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-96ca3d05-b95a-48dd-8b46-479211360691 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:06.302411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dad2baea-9953-4c43-9fc8-e030471a5082 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:06.311764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dad2baea-9953-4c43-9fc8-e030471a5082 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.185069 Jun 21 15:58:06.321165 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 273/531] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:06 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:06.413795 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-acd9f03b-80f9-4149-b02e-28857b727874 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:06.414863 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-acd9f03b-80f9-4149-b02e-28857b727874 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:06.422153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-acd9f03b-80f9-4149-b02e-28857b727874 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:06.422952 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-acd9f03b-80f9-4149-b02e-28857b727874 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:06.424107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-acd9f03b-80f9-4149-b02e-28857b727874 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:06.424927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-acd9f03b-80f9-4149-b02e-28857b727874 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:06.555471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-96ca3d05-b95a-48dd-8b46-479211360691 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:06.564225 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-96ca3d05-b95a-48dd-8b46-479211360691 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.300904 Jun 21 15:58:06.578160 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 259/532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:06 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:06.633601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-acd9f03b-80f9-4149-b02e-28857b727874 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:06.643009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-acd9f03b-80f9-4149-b02e-28857b727874 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.234926 Jun 21 15:58:06.643811 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 274/533] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:06 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:06.897005 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:06.898102 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:06.906874 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:06.907334 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:06.908551 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:06.909765 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:06.961277 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:07.078117 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:07.088482 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:07.091195 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:07.092590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-54bc2dbd-a206-4f45-9c89-4ca7fea5ae73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.199538 Jun 21 15:58:07.108816 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 260/534] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:06 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:07.328757 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-91baefd3-4c21-4756-8d48-1972239a963a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:07.329342 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-91baefd3-4c21-4756-8d48-1972239a963a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:07.337059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91baefd3-4c21-4756-8d48-1972239a963a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:07.337539 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91baefd3-4c21-4756-8d48-1972239a963a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:07.338491 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91baefd3-4c21-4756-8d48-1972239a963a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:07.339235 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91baefd3-4c21-4756-8d48-1972239a963a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:07.502584 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-91baefd3-4c21-4756-8d48-1972239a963a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:07.514146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-91baefd3-4c21-4756-8d48-1972239a963a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.189247 Jun 21 15:58:07.514756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 275/535] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:07 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:07.586454 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-63f2d221-6f96-429b-891c-c2e7d5bea609 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:07.587673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-63f2d221-6f96-429b-891c-c2e7d5bea609 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:07.597321 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-63f2d221-6f96-429b-891c-c2e7d5bea609 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:07.598243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-63f2d221-6f96-429b-891c-c2e7d5bea609 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:07.599656 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-63f2d221-6f96-429b-891c-c2e7d5bea609 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:07.600697 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-63f2d221-6f96-429b-891c-c2e7d5bea609 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:07.662059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-677d060b-765a-4930-83d8-6ba7ebd77bd4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:07.663272 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-677d060b-765a-4930-83d8-6ba7ebd77bd4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:07.681242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-677d060b-765a-4930-83d8-6ba7ebd77bd4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:07.685201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-677d060b-765a-4930-83d8-6ba7ebd77bd4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:07.693806 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-677d060b-765a-4930-83d8-6ba7ebd77bd4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:07.694512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-677d060b-765a-4930-83d8-6ba7ebd77bd4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:07.752247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:07.773440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=10 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:07.810411 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-63f2d221-6f96-429b-891c-c2e7d5bea609 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:07.822288 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-63f2d221-6f96-429b-891c-c2e7d5bea609 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.243128 Jun 21 15:58:07.823528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 261/536] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:07 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:07.902454 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-677d060b-765a-4930-83d8-6ba7ebd77bd4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:07.911884 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-677d060b-765a-4930-83d8-6ba7ebd77bd4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.253776 Jun 21 15:58:07.912749 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 276/537] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:07 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:08.115138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:08.117509 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:08.127492 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=14 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:08.130315 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:08.131019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:08.132040 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:08.132979 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:08.325131 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:08.334078 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:08.336818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:08.338015 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-41d766ec-56fe-4fba-adef-ac9689f3c07f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.226840 Jun 21 15:58:08.341813 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 262/538] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:08 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:08.534170 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-793d724a-2442-4ec1-bc2a-01a26302eecc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:08.534822 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-793d724a-2442-4ec1-bc2a-01a26302eecc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:08.541829 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-793d724a-2442-4ec1-bc2a-01a26302eecc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:08.542379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-793d724a-2442-4ec1-bc2a-01a26302eecc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:08.543234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-793d724a-2442-4ec1-bc2a-01a26302eecc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:08.543683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-793d724a-2442-4ec1-bc2a-01a26302eecc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:08.681906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-793d724a-2442-4ec1-bc2a-01a26302eecc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:08.691809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-793d724a-2442-4ec1-bc2a-01a26302eecc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.161853 Jun 21 15:58:08.692551 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 277/539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:08 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:08.848326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-cdbcf2a7-71f7-4c40-8ace-4bf3cb8cc0b8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:08.849048 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-cdbcf2a7-71f7-4c40-8ace-4bf3cb8cc0b8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:08.859906 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cdbcf2a7-71f7-4c40-8ace-4bf3cb8cc0b8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:08.860434 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cdbcf2a7-71f7-4c40-8ace-4bf3cb8cc0b8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:08.861269 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cdbcf2a7-71f7-4c40-8ace-4bf3cb8cc0b8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:08.861763 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cdbcf2a7-71f7-4c40-8ace-4bf3cb8cc0b8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:08.929562 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7ebbb9b1-8dbd-466c-b7f3-5f81d9019e12 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:08.930777 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7ebbb9b1-8dbd-466c-b7f3-5f81d9019e12 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:08.941056 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ebbb9b1-8dbd-466c-b7f3-5f81d9019e12 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:08.941812 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ebbb9b1-8dbd-466c-b7f3-5f81d9019e12 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:08.942768 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ebbb9b1-8dbd-466c-b7f3-5f81d9019e12 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:08.947289 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7ebbb9b1-8dbd-466c-b7f3-5f81d9019e12 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:09.075797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cdbcf2a7-71f7-4c40-8ace-4bf3cb8cc0b8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:09.083992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-cdbcf2a7-71f7-4c40-8ace-4bf3cb8cc0b8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.239564 Jun 21 15:58:09.094677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 263/540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:08 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:09.138989 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7ebbb9b1-8dbd-466c-b7f3-5f81d9019e12 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:09.148696 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7ebbb9b1-8dbd-466c-b7f3-5f81d9019e12 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.222196 Jun 21 15:58:09.159638 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 278/541] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:08 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:09.356730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:09.357311 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:09.371847 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:09.372924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:09.375116 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:09.375804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:09.408091 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:09.535956 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:09.545060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:09.546685 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:09.548070 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-da3357d5-5d11-4eeb-b7f2-8073aff7c1de tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.195379 Jun 21 15:58:09.548853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 264/542] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:09 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:09.709168 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4d67d196-d436-4e97-944e-3ae77e9c406f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:09.709750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4d67d196-d436-4e97-944e-3ae77e9c406f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:09.720673 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4d67d196-d436-4e97-944e-3ae77e9c406f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:09.721110 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4d67d196-d436-4e97-944e-3ae77e9c406f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:09.724140 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4d67d196-d436-4e97-944e-3ae77e9c406f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:09.724572 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4d67d196-d436-4e97-944e-3ae77e9c406f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:09.800547 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-9a276758-fb7b-42cf-9bbe-2dd822664f39 req-468ebbfe-c2dd-4885-a6ce-5b871bd6b542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5afaf8-702b-44ef-bafd-b80903345966", "name": "network-vif-plugged", "status": "completed", "tag": "d74a9552-5153-4ad9-8130-43325526cc8b"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:09.827917 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-9a276758-fb7b-42cf-9bbe-2dd822664f39 req-468ebbfe-c2dd-4885-a6ce-5b871bd6b542 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:09.828359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-9a276758-fb7b-42cf-9bbe-2dd822664f39 req-468ebbfe-c2dd-4885-a6ce-5b871bd6b542 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:09.856745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-9a276758-fb7b-42cf-9bbe-2dd822664f39 req-468ebbfe-c2dd-4885-a6ce-5b871bd6b542 service nova] Creating event network-vif-plugged:d74a9552-5153-4ad9-8130-43325526cc8b for instance db5afaf8-702b-44ef-bafd-b80903345966 on hv-cinder-84067 Jun 21 15:58:09.884282 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-9a276758-fb7b-42cf-9bbe-2dd822664f39 req-468ebbfe-c2dd-4885-a6ce-5b871bd6b542 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086698 Jun 21 15:58:09.892220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 265/543] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:58:09.952628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4d67d196-d436-4e97-944e-3ae77e9c406f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:09.962602 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4d67d196-d436-4e97-944e-3ae77e9c406f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.257953 Jun 21 15:58:09.963462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 279/544] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:09 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:10.103099 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c26f7916-f9ec-4297-964a-ae112d066bc3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:10.103806 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c26f7916-f9ec-4297-964a-ae112d066bc3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:10.111813 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c26f7916-f9ec-4297-964a-ae112d066bc3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:10.112594 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c26f7916-f9ec-4297-964a-ae112d066bc3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:10.113351 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c26f7916-f9ec-4297-964a-ae112d066bc3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:10.114037 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c26f7916-f9ec-4297-964a-ae112d066bc3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:10.166911 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b2fa4f4b-1fa0-40f7-8644-bc64718ae8df tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:10.167516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b2fa4f4b-1fa0-40f7-8644-bc64718ae8df tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:10.173881 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b2fa4f4b-1fa0-40f7-8644-bc64718ae8df tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:10.174580 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b2fa4f4b-1fa0-40f7-8644-bc64718ae8df tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:10.175599 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b2fa4f4b-1fa0-40f7-8644-bc64718ae8df tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:10.175999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b2fa4f4b-1fa0-40f7-8644-bc64718ae8df tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:10.442254 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c26f7916-f9ec-4297-964a-ae112d066bc3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:10.450083 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b2fa4f4b-1fa0-40f7-8644-bc64718ae8df tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:10.459017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b2fa4f4b-1fa0-40f7-8644-bc64718ae8df tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.296114 Jun 21 15:58:10.463481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c26f7916-f9ec-4297-964a-ae112d066bc3 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.365011 Jun 21 15:58:10.464653 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 266/545] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:10 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:10.469287 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 280/546] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:10 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:10.567730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:10.568284 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:10.578048 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:10.578480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:10.579878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:10.580495 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:10.724754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:10.734124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:10.735633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:10.736980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2a6a5432-ca5d-454d-acc3-dd10ecec95b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.173676 Jun 21 15:58:10.737879 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 267/547] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:10 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:10.994565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-92e3f65e-4e9c-47d4-bb9a-864f2fa16e14 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:10.995926 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-92e3f65e-4e9c-47d4-bb9a-864f2fa16e14 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:11.017361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-92e3f65e-4e9c-47d4-bb9a-864f2fa16e14 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:11.018254 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-92e3f65e-4e9c-47d4-bb9a-864f2fa16e14 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:11.019348 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-92e3f65e-4e9c-47d4-bb9a-864f2fa16e14 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:11.022942 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-92e3f65e-4e9c-47d4-bb9a-864f2fa16e14 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:11.309664 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-92e3f65e-4e9c-47d4-bb9a-864f2fa16e14 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:11.320727 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-92e3f65e-4e9c-47d4-bb9a-864f2fa16e14 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.340845 Jun 21 15:58:11.330722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 281/548] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:10 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:11.483063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5685a8bc-533d-4925-a930-ea66c198f50a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:11.484177 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5685a8bc-533d-4925-a930-ea66c198f50a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:11.484723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ee452ce2-db09-4730-9cd7-4176bc9a4186 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:11.485484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ee452ce2-db09-4730-9cd7-4176bc9a4186 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:11.492997 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5685a8bc-533d-4925-a930-ea66c198f50a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:11.493530 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5685a8bc-533d-4925-a930-ea66c198f50a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:11.494657 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5685a8bc-533d-4925-a930-ea66c198f50a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:11.495165 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5685a8bc-533d-4925-a930-ea66c198f50a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:11.521910 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee452ce2-db09-4730-9cd7-4176bc9a4186 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:11.523107 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee452ce2-db09-4730-9cd7-4176bc9a4186 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:11.526174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee452ce2-db09-4730-9cd7-4176bc9a4186 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:11.528403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee452ce2-db09-4730-9cd7-4176bc9a4186 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:11.882011 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5685a8bc-533d-4925-a930-ea66c198f50a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:11.896180 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ee452ce2-db09-4730-9cd7-4176bc9a4186 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:11.906911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ee452ce2-db09-4730-9cd7-4176bc9a4186 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.434095 Jun 21 15:58:11.909504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 268/549] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:11 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:11.916103 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:11.916966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:11.924749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:11.924749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:11.925907 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:11.926347 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:11.927222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5685a8bc-533d-4925-a930-ea66c198f50a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.448261 Jun 21 15:58:11.931687 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 282/550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:11 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:12.125598 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:12.136545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:12.139638 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:12.141606 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-31eb2967-5f6e-4826-862c-5de4ec0529b3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.230793 Jun 21 15:58:12.142666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 269/551] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:11 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:12.149108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-063ae217-5d26-4efb-8408-8f729d54914c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:12.150516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-063ae217-5d26-4efb-8408-8f729d54914c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:12.157659 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-063ae217-5d26-4efb-8408-8f729d54914c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:12.158202 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-063ae217-5d26-4efb-8408-8f729d54914c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:12.159082 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-063ae217-5d26-4efb-8408-8f729d54914c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:12.159607 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-063ae217-5d26-4efb-8408-8f729d54914c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:12.162785 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:12.328339 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-063ae217-5d26-4efb-8408-8f729d54914c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:12.338265 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-063ae217-5d26-4efb-8408-8f729d54914c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1594 microversion: 2.1 time: 0.193436 Jun 21 15:58:12.339074 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4f0e4073-8539-40ba-b4f8-ee8e99bbf805 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:12.339214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 283/552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:12 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1594 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:12.339631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4f0e4073-8539-40ba-b4f8-ee8e99bbf805 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:12.350627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4f0e4073-8539-40ba-b4f8-ee8e99bbf805 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:12.350627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4f0e4073-8539-40ba-b4f8-ee8e99bbf805 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:12.350627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4f0e4073-8539-40ba-b4f8-ee8e99bbf805 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:12.350627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4f0e4073-8539-40ba-b4f8-ee8e99bbf805 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:12.847004 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4f0e4073-8539-40ba-b4f8-ee8e99bbf805 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:12.858350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4f0e4073-8539-40ba-b4f8-ee8e99bbf805 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.523869 Jun 21 15:58:12.858910 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 270/553] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:12 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:12.929383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4fe17dba-637e-4ca5-a21c-08adf7ee5609 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:12.931126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4fe17dba-637e-4ca5-a21c-08adf7ee5609 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:12.950832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8cca986b-ff6a-4ae5-99a2-28eb1f44d957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:12.951989 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8cca986b-ff6a-4ae5-99a2-28eb1f44d957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:12.956506 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4fe17dba-637e-4ca5-a21c-08adf7ee5609 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:12.956692 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4fe17dba-637e-4ca5-a21c-08adf7ee5609 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:12.957621 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4fe17dba-637e-4ca5-a21c-08adf7ee5609 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:12.957858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4fe17dba-637e-4ca5-a21c-08adf7ee5609 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:12.962694 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8cca986b-ff6a-4ae5-99a2-28eb1f44d957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:12.963986 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8cca986b-ff6a-4ae5-99a2-28eb1f44d957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:12.968827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8cca986b-ff6a-4ae5-99a2-28eb1f44d957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:12.970504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8cca986b-ff6a-4ae5-99a2-28eb1f44d957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:13.277177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8cca986b-ff6a-4ae5-99a2-28eb1f44d957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:13.291624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8cca986b-ff6a-4ae5-99a2-28eb1f44d957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.346245 Jun 21 15:58:13.293021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 271/554] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:12 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:13.296073 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4fe17dba-637e-4ca5-a21c-08adf7ee5609 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:13.302041 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:13.302966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:13.309187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4fe17dba-637e-4ca5-a21c-08adf7ee5609 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.387398 Jun 21 15:58:13.309900 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 284/555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:12 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:13.323060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:13.323060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:13.323060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:13.323060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:13.597897 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:13.608377 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:13.610018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:13.611594 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8fe86074-855c-4415-8ddb-31070fe3cc5d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.316582 Jun 21 15:58:13.612278 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 272/556] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:13 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:13.731558 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c3fc55ac-2d0e-4a43-9645-da5d74bd0d8d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:13.732056 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c3fc55ac-2d0e-4a43-9645-da5d74bd0d8d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:13.740681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c3fc55ac-2d0e-4a43-9645-da5d74bd0d8d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:13.741252 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c3fc55ac-2d0e-4a43-9645-da5d74bd0d8d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:13.742275 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c3fc55ac-2d0e-4a43-9645-da5d74bd0d8d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:13.742700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c3fc55ac-2d0e-4a43-9645-da5d74bd0d8d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:13.768468 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c3fc55ac-2d0e-4a43-9645-da5d74bd0d8d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 15:58:13.836285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:13.856625 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c3fc55ac-2d0e-4a43-9645-da5d74bd0d8d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 204 len: 0 microversion: 2.1 time: 0.128637 Jun 21 15:58:13.860620 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 285/557] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 15:58:13 2022] DELETE /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 15:58:13.866547 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-13f5c457-edf8-485f-9605-49109c4a4ca6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:13.868178 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-13f5c457-edf8-485f-9605-49109c4a4ca6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:13.874647 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13f5c457-edf8-485f-9605-49109c4a4ca6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:13.875367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13f5c457-edf8-485f-9605-49109c4a4ca6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:13.876345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13f5c457-edf8-485f-9605-49109c4a4ca6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:13.876928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13f5c457-edf8-485f-9605-49109c4a4ca6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:13.877820 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4e882029-2673-4b1e-9048-71a78f672491 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:13.878661 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4e882029-2673-4b1e-9048-71a78f672491 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:13.886199 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e882029-2673-4b1e-9048-71a78f672491 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:13.886804 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e882029-2673-4b1e-9048-71a78f672491 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:13.887632 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e882029-2673-4b1e-9048-71a78f672491 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:13.888259 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e882029-2673-4b1e-9048-71a78f672491 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:14.214755 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4e882029-2673-4b1e-9048-71a78f672491 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:14.221308 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-13f5c457-edf8-485f-9605-49109c4a4ca6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:14.226505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4e882029-2673-4b1e-9048-71a78f672491 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.353356 Jun 21 15:58:14.236191 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 286/558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:13 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:14.241320 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-df78128a-ea5e-4852-a5b3-7771dd49a662 req-8c44459e-d88d-40e4-9bbe-91bb4d4368cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e069614-4aff-4e07-841c-31317d94f447", "name": "network-vif-plugged", "status": "completed", "tag": "11038423-70d0-440b-b68d-35bfa6a0d923"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:14.247087 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-13f5c457-edf8-485f-9605-49109c4a4ca6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1513 microversion: 2.1 time: 0.384454 Jun 21 15:58:14.249432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 273/559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:13 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1513 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:14.253242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-df78128a-ea5e-4852-a5b3-7771dd49a662 req-8c44459e-d88d-40e4-9bbe-91bb4d4368cf service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:14.253681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-df78128a-ea5e-4852-a5b3-7771dd49a662 req-8c44459e-d88d-40e4-9bbe-91bb4d4368cf service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:14.271700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-df78128a-ea5e-4852-a5b3-7771dd49a662 req-8c44459e-d88d-40e4-9bbe-91bb4d4368cf service nova] Creating event network-vif-plugged:11038423-70d0-440b-b68d-35bfa6a0d923 for instance 8e069614-4aff-4e07-841c-31317d94f447 on hv-cinder-84067 Jun 21 15:58:14.277563 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-df78128a-ea5e-4852-a5b3-7771dd49a662 req-8c44459e-d88d-40e4-9bbe-91bb4d4368cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039865 Jun 21 15:58:14.278187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 287/560] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:14.309074 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e9c4cee9-1b84-41c9-a87d-8078781a3200 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:14.309681 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e9c4cee9-1b84-41c9-a87d-8078781a3200 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:14.316327 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e9c4cee9-1b84-41c9-a87d-8078781a3200 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:14.316771 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e9c4cee9-1b84-41c9-a87d-8078781a3200 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:14.317540 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e9c4cee9-1b84-41c9-a87d-8078781a3200 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:14.318009 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e9c4cee9-1b84-41c9-a87d-8078781a3200 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:14.330878 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b1ffcdfb-6a6e-4e36-9e41-d46d1d3f6afd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:14.332048 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b1ffcdfb-6a6e-4e36-9e41-d46d1d3f6afd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:14.341113 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b1ffcdfb-6a6e-4e36-9e41-d46d1d3f6afd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:14.342162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b1ffcdfb-6a6e-4e36-9e41-d46d1d3f6afd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:14.342890 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b1ffcdfb-6a6e-4e36-9e41-d46d1d3f6afd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:14.343646 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b1ffcdfb-6a6e-4e36-9e41-d46d1d3f6afd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:14.606497 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b1ffcdfb-6a6e-4e36-9e41-d46d1d3f6afd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:14.610875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e9c4cee9-1b84-41c9-a87d-8078781a3200 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:14.616622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b1ffcdfb-6a6e-4e36-9e41-d46d1d3f6afd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.290221 Jun 21 15:58:14.617216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 288/561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:14 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:14.620815 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e9c4cee9-1b84-41c9-a87d-8078781a3200 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.315786 Jun 21 15:58:14.621694 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 274/562] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:14 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:14.630242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:14.631228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:14.638278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:14.638725 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:14.639507 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:14.639958 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.085021 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:15.094377 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:15.095886 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:15.097068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-606e007e-63c7-4282-bcb2-0e37f76a7cc2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.470971 Jun 21 15:58:15.097616 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 289/563] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:14 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:15.244573 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-20355c24-9cd6-413f-bafd-368314a8ba6a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:15.245178 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-20355c24-9cd6-413f-bafd-368314a8ba6a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:15.252014 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-20355c24-9cd6-413f-bafd-368314a8ba6a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.252454 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-20355c24-9cd6-413f-bafd-368314a8ba6a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.253220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-20355c24-9cd6-413f-bafd-368314a8ba6a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.253652 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-20355c24-9cd6-413f-bafd-368314a8ba6a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.268634 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1a1b036f-92f9-4c76-a5a1-914709c31fa3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:15.269244 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1a1b036f-92f9-4c76-a5a1-914709c31fa3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:15.276787 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1a1b036f-92f9-4c76-a5a1-914709c31fa3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.277516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1a1b036f-92f9-4c76-a5a1-914709c31fa3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.278338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1a1b036f-92f9-4c76-a5a1-914709c31fa3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.278899 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1a1b036f-92f9-4c76-a5a1-914709c31fa3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.561875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-20355c24-9cd6-413f-bafd-368314a8ba6a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:15.570255 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-20355c24-9cd6-413f-bafd-368314a8ba6a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.329426 Jun 21 15:58:15.571135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 275/564] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:15 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:15.591658 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1a1b036f-92f9-4c76-a5a1-914709c31fa3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:15.599582 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1a1b036f-92f9-4c76-a5a1-914709c31fa3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1513 microversion: 2.1 time: 0.334785 Jun 21 15:58:15.600160 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 290/565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:15 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1513 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:15.634153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7f0b7b30-d32f-4b44-86e5-d14bc13ca0f5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:15.634744 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7f0b7b30-d32f-4b44-86e5-d14bc13ca0f5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:15.640973 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-54c4b11e-997c-4644-856c-88ebc38d21e1 req-3ac06b65-2779-4cf4-a4d4-9e283834d0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b86eef-f566-4e16-bcb1-779a14e4ec90", "tag": "e2a0a9e4-f360-48ee-8bfa-9a53de846467"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:15.641232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f0b7b30-d32f-4b44-86e5-d14bc13ca0f5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.641669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f0b7b30-d32f-4b44-86e5-d14bc13ca0f5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.642433 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f0b7b30-d32f-4b44-86e5-d14bc13ca0f5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.643025 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f0b7b30-d32f-4b44-86e5-d14bc13ca0f5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.655823 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-54c4b11e-997c-4644-856c-88ebc38d21e1 req-3ac06b65-2779-4cf4-a4d4-9e283834d0d7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.657071 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-54c4b11e-997c-4644-856c-88ebc38d21e1 req-3ac06b65-2779-4cf4-a4d4-9e283834d0d7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.673467 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-54c4b11e-997c-4644-856c-88ebc38d21e1 req-3ac06b65-2779-4cf4-a4d4-9e283834d0d7 service nova] Creating event network-changed:e2a0a9e4-f360-48ee-8bfa-9a53de846467 for instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 on hv-cinder-84067 Jun 21 15:58:15.679701 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-54c4b11e-997c-4644-856c-88ebc38d21e1 req-3ac06b65-2779-4cf4-a4d4-9e283834d0d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047154 Jun 21 15:58:15.681278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 291/566] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:15.687199 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4e67c053-13a9-4a0f-9468-45b69d634584 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:15.687970 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4e67c053-13a9-4a0f-9468-45b69d634584 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:15.694872 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e67c053-13a9-4a0f-9468-45b69d634584 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.695573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e67c053-13a9-4a0f-9468-45b69d634584 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.697103 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e67c053-13a9-4a0f-9468-45b69d634584 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:15.697693 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e67c053-13a9-4a0f-9468-45b69d634584 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:15.872713 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7f0b7b30-d32f-4b44-86e5-d14bc13ca0f5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:15.890417 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7f0b7b30-d32f-4b44-86e5-d14bc13ca0f5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1371 microversion: 2.1 time: 0.260604 Jun 21 15:58:15.890984 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 276/567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:15 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:15.969494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4e67c053-13a9-4a0f-9468-45b69d634584 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:15.979790 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4e67c053-13a9-4a0f-9468-45b69d634584 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.296815 Jun 21 15:58:15.980382 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 292/568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:15 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:16.115927 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:16.116964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:16.123448 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.124132 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.125053 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.125647 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.307102 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:16.315798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:16.317615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:16.319133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0801a64f-cf85-41c4-aa7b-1fd537b53aaa tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1739 microversion: 2.20 time: 0.207341 Jun 21 15:58:16.320340 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 277/569] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:16 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:16.588948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-55091a86-a4ee-420f-8c21-155e7712d0be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:16.590192 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-55091a86-a4ee-420f-8c21-155e7712d0be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:16.597458 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-55091a86-a4ee-420f-8c21-155e7712d0be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.599008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-55091a86-a4ee-420f-8c21-155e7712d0be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.600046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-55091a86-a4ee-420f-8c21-155e7712d0be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.601050 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-55091a86-a4ee-420f-8c21-155e7712d0be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.616821 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d324f7f6-eacc-45b3-b0d1-21bb91288fb1 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:16.617873 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d324f7f6-eacc-45b3-b0d1-21bb91288fb1 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:16.630225 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d324f7f6-eacc-45b3-b0d1-21bb91288fb1 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.630665 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d324f7f6-eacc-45b3-b0d1-21bb91288fb1 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.631436 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d324f7f6-eacc-45b3-b0d1-21bb91288fb1 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.631861 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d324f7f6-eacc-45b3-b0d1-21bb91288fb1 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.847403 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-55091a86-a4ee-420f-8c21-155e7712d0be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:16.852250 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d324f7f6-eacc-45b3-b0d1-21bb91288fb1 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:16.857522 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-55091a86-a4ee-420f-8c21-155e7712d0be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.272665 Jun 21 15:58:16.858822 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 293/570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:16 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:16.860875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d324f7f6-eacc-45b3-b0d1-21bb91288fb1 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1513 microversion: 2.1 time: 0.248099 Jun 21 15:58:16.861588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 278/571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:16 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:16.884972 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2ff2aed1-6e67-4f52-be08-735338685a7c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1394046937"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:16.885576 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2ff2aed1-6e67-4f52-be08-735338685a7c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:16.893065 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ff2aed1-6e67-4f52-be08-735338685a7c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.894202 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ff2aed1-6e67-4f52-be08-735338685a7c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.895072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ff2aed1-6e67-4f52-be08-735338685a7c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.895521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ff2aed1-6e67-4f52-be08-735338685a7c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.908555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d7123b74-84ba-4d46-9f13-dc4bd5f6e74c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:16.909468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d7123b74-84ba-4d46-9f13-dc4bd5f6e74c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:16.916936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d7123b74-84ba-4d46-9f13-dc4bd5f6e74c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.917459 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d7123b74-84ba-4d46-9f13-dc4bd5f6e74c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:16.918324 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d7123b74-84ba-4d46-9f13-dc4bd5f6e74c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:16.918811 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d7123b74-84ba-4d46-9f13-dc4bd5f6e74c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:17.084350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.network.security_group_api [None req-2ff2aed1-6e67-4f52-be08-735338685a7c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Adding security group cae86658-7211-442c-a7a8-ad76edc10415 to port e2a0a9e4-f360-48ee-8bfa-9a53de846467 Jun 21 15:58:17.150950 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d7123b74-84ba-4d46-9f13-dc4bd5f6e74c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:17.159435 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d7123b74-84ba-4d46-9f13-dc4bd5f6e74c tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1565 microversion: 2.1 time: 0.254917 Jun 21 15:58:17.160038 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 279/572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:16 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:17.165227 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e398ac1c-d63b-4e6a-95ce-356d27b2202e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:17.165865 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e398ac1c-d63b-4e6a-95ce-356d27b2202e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:17.172096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e398ac1c-d63b-4e6a-95ce-356d27b2202e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:17.172819 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e398ac1c-d63b-4e6a-95ce-356d27b2202e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:17.173588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e398ac1c-d63b-4e6a-95ce-356d27b2202e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:17.174028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e398ac1c-d63b-4e6a-95ce-356d27b2202e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:17.409886 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e398ac1c-d63b-4e6a-95ce-356d27b2202e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:17.421112 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e398ac1c-d63b-4e6a-95ce-356d27b2202e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.259966 Jun 21 15:58:17.422001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 280/573] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:17 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:17.426887 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9d7f7d27-6225-4982-9164-f1544e26524b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:17.427464 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9d7f7d27-6225-4982-9164-f1544e26524b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:17.434969 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9d7f7d27-6225-4982-9164-f1544e26524b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:17.435816 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9d7f7d27-6225-4982-9164-f1544e26524b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:17.436649 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9d7f7d27-6225-4982-9164-f1544e26524b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:17.437231 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9d7f7d27-6225-4982-9164-f1544e26524b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:17.558359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9d7f7d27-6225-4982-9164-f1544e26524b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135032 Jun 21 15:58:17.558995 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 281/574] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jun 21 15:58:17 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:17.564150 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:17.566067 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:17.573261 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:17.574154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:17.574934 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:17.575572 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:17.580378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:17.917005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2ff2aed1-6e67-4f52-be08-735338685a7c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "POST /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/action" status: 202 len: 0 microversion: 2.1 time: 1.036360 Jun 21 15:58:17.918360 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 294/575] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 15:58:16 2022] POST /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/action => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 15:58:17.923944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-256354cd-417a-4881-b9b0-b0dbf43e0bfa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:17.924757 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-256354cd-417a-4881-b9b0-b0dbf43e0bfa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:17.932015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-256354cd-417a-4881-b9b0-b0dbf43e0bfa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:17.932757 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-256354cd-417a-4881-b9b0-b0dbf43e0bfa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:17.933966 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-256354cd-417a-4881-b9b0-b0dbf43e0bfa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:17.938843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-256354cd-417a-4881-b9b0-b0dbf43e0bfa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:18.222476 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:18.233536 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:18.235373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:18.238787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9010206d-39e0-42d9-ad0c-07822695ed0f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1721 microversion: 2.20 time: 0.678442 Jun 21 15:58:18.240246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 282/576] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:17 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1721 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:18.246349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3978fec8-c506-4c7c-87b9-ebff100b650d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:18.247168 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3978fec8-c506-4c7c-87b9-ebff100b650d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:18.254754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3978fec8-c506-4c7c-87b9-ebff100b650d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:18.255468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3978fec8-c506-4c7c-87b9-ebff100b650d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:18.256550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3978fec8-c506-4c7c-87b9-ebff100b650d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:18.257380 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3978fec8-c506-4c7c-87b9-ebff100b650d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:18.830791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-256354cd-417a-4881-b9b0-b0dbf43e0bfa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:18.838155 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-256354cd-417a-4881-b9b0-b0dbf43e0bfa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.918337 Jun 21 15:58:18.838722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 295/577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:17 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:18.843692 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2168a0f2-60f2-46ce-ab81-a8c07f2152b7 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:18.844288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2168a0f2-60f2-46ce-ab81-a8c07f2152b7 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:18.850518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2168a0f2-60f2-46ce-ab81-a8c07f2152b7 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:18.851034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2168a0f2-60f2-46ce-ab81-a8c07f2152b7 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:18.852291 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2168a0f2-60f2-46ce-ab81-a8c07f2152b7 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:18.854473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2168a0f2-60f2-46ce-ab81-a8c07f2152b7 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:18.984305 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3978fec8-c506-4c7c-87b9-ebff100b650d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:18.993428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3978fec8-c506-4c7c-87b9-ebff100b650d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1513 microversion: 2.1 time: 0.751898 Jun 21 15:58:19.003421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 283/578] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:18 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1513 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:19.007912 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-d054dab8-f172-4d90-b4c9-429300abe00f req-32a5c23f-2eb6-40b4-9c1f-69182fde5ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b86eef-f566-4e16-bcb1-779a14e4ec90", "tag": "e2a0a9e4-f360-48ee-8bfa-9a53de846467"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:19.016046 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-d054dab8-f172-4d90-b4c9-429300abe00f req-32a5c23f-2eb6-40b4-9c1f-69182fde5ff7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:19.016499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-d054dab8-f172-4d90-b4c9-429300abe00f req-32a5c23f-2eb6-40b4-9c1f-69182fde5ff7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:19.031664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-d054dab8-f172-4d90-b4c9-429300abe00f req-32a5c23f-2eb6-40b4-9c1f-69182fde5ff7 service nova] Creating event network-changed:e2a0a9e4-f360-48ee-8bfa-9a53de846467 for instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 on hv-cinder-84067 Jun 21 15:58:19.037495 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-d054dab8-f172-4d90-b4c9-429300abe00f req-32a5c23f-2eb6-40b4-9c1f-69182fde5ff7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042268 Jun 21 15:58:19.038226 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 284/579] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:19.043802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-445f37d9-2c43-43af-b358-02931f0e98ad tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:19.044550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-445f37d9-2c43-43af-b358-02931f0e98ad tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:19.051692 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-445f37d9-2c43-43af-b358-02931f0e98ad tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:19.052136 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-445f37d9-2c43-43af-b358-02931f0e98ad tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:19.052923 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-445f37d9-2c43-43af-b358-02931f0e98ad tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:19.053355 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-445f37d9-2c43-43af-b358-02931f0e98ad tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:19.278204 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2168a0f2-60f2-46ce-ab81-a8c07f2152b7 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:19.288696 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2168a0f2-60f2-46ce-ab81-a8c07f2152b7 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1641 microversion: 2.1 time: 0.448323 Jun 21 15:58:19.289861 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 296/580] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:18 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1641 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:19.306056 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:19.306816 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:19.313700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:19.314202 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:19.315005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:19.315528 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:19.471373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-445f37d9-2c43-43af-b358-02931f0e98ad tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:19.479902 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-445f37d9-2c43-43af-b358-02931f0e98ad tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.439998 Jun 21 15:58:19.480439 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 285/581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:19 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:19.697355 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:19.706041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:19.707541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:19.708711 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-04a7b52b-8460-406a-8e78-7c179745ea14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1721 microversion: 2.20 time: 0.406729 Jun 21 15:58:19.709344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 297/582] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:19 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:19.855919 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a65dfcc5-b777-4cbc-af38-19b771c7e913 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:19.856426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a65dfcc5-b777-4cbc-af38-19b771c7e913 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:19.863430 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a65dfcc5-b777-4cbc-af38-19b771c7e913 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:19.863866 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a65dfcc5-b777-4cbc-af38-19b771c7e913 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:19.864629 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a65dfcc5-b777-4cbc-af38-19b771c7e913 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:19.865068 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a65dfcc5-b777-4cbc-af38-19b771c7e913 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:20.012415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-609fbff1-242a-4c04-bfac-a29fb9da854e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:20.013026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-609fbff1-242a-4c04-bfac-a29fb9da854e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:20.016925 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a65dfcc5-b777-4cbc-af38-19b771c7e913 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:20.019846 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-609fbff1-242a-4c04-bfac-a29fb9da854e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:20.020649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-609fbff1-242a-4c04-bfac-a29fb9da854e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:20.021605 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-609fbff1-242a-4c04-bfac-a29fb9da854e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:20.022086 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-609fbff1-242a-4c04-bfac-a29fb9da854e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:20.025970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a65dfcc5-b777-4cbc-af38-19b771c7e913 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.174031 Jun 21 15:58:20.026982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 286/583] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:19 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:20.088929 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-609fbff1-242a-4c04-bfac-a29fb9da854e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:20.099469 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-609fbff1-242a-4c04-bfac-a29fb9da854e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1471 microversion: 2.1 time: 0.091132 Jun 21 15:58:20.100554 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 298/584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:20 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1471 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:20.498891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3021b93c-0a88-4bf8-890a-3f22ddb01df5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:20.499743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3021b93c-0a88-4bf8-890a-3f22ddb01df5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:20.507268 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3021b93c-0a88-4bf8-890a-3f22ddb01df5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:20.507776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3021b93c-0a88-4bf8-890a-3f22ddb01df5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:20.508947 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3021b93c-0a88-4bf8-890a-3f22ddb01df5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:20.509412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3021b93c-0a88-4bf8-890a-3f22ddb01df5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:20.645336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3021b93c-0a88-4bf8-890a-3f22ddb01df5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:20.653839 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3021b93c-0a88-4bf8-890a-3f22ddb01df5 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.159001 Jun 21 15:58:20.654339 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 287/585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:20 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:20.728517 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:20.729291 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:20.736417 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:20.736943 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:20.737712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:20.738188 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:20.884693 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:20.887235 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:20.895318 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:20.896797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:20.898840 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2824e172-41bb-4489-a453-ea3aee6b3141 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1721 microversion: 2.20 time: 0.174319 Jun 21 15:58:20.899474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 299/586] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:20 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:21.044561 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dadb35d3-3ef0-413a-862f-a04edb22bd1f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:21.045157 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dadb35d3-3ef0-413a-862f-a04edb22bd1f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:21.051938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dadb35d3-3ef0-413a-862f-a04edb22bd1f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.052374 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dadb35d3-3ef0-413a-862f-a04edb22bd1f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:21.053154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dadb35d3-3ef0-413a-862f-a04edb22bd1f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.053604 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dadb35d3-3ef0-413a-862f-a04edb22bd1f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:21.079346 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-0bd7c302-d85b-443a-afb0-98ce3ccdf59b req-18979d86-8b77-4913-bdfa-f49a4f7fc37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51b581b-07bc-41e2-9dfb-1db8bf770e8d", "name": "network-vif-deleted", "tag": "61c59913-d0bf-44b8-b08a-75e6782dac10"}, {"name": "network-changed", "server_uuid": "db5afaf8-702b-44ef-bafd-b80903345966", "tag": "d74a9552-5153-4ad9-8130-43325526cc8b"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:21.090405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0bd7c302-d85b-443a-afb0-98ce3ccdf59b req-18979d86-8b77-4913-bdfa-f49a4f7fc37a service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.090880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0bd7c302-d85b-443a-afb0-98ce3ccdf59b req-18979d86-8b77-4913-bdfa-f49a4f7fc37a service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:21.108109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-0bd7c302-d85b-443a-afb0-98ce3ccdf59b req-18979d86-8b77-4913-bdfa-f49a4f7fc37a service nova] Creating event network-vif-deleted:61c59913-d0bf-44b8-b08a-75e6782dac10 for instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d on hv-cinder-84067 Jun 21 15:58:21.108610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-0bd7c302-d85b-443a-afb0-98ce3ccdf59b req-18979d86-8b77-4913-bdfa-f49a4f7fc37a service nova] Creating event network-changed:d74a9552-5153-4ad9-8130-43325526cc8b for instance db5afaf8-702b-44ef-bafd-b80903345966 on hv-cinder-84067 Jun 21 15:58:21.116974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-0bd7c302-d85b-443a-afb0-98ce3ccdf59b req-18979d86-8b77-4913-bdfa-f49a4f7fc37a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042466 Jun 21 15:58:21.117694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 300/587] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:58:21.123059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d1b34e58-7156-4590-a401-df64c8337e63 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:21.124001 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d1b34e58-7156-4590-a401-df64c8337e63 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:21.132028 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d1b34e58-7156-4590-a401-df64c8337e63 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.132984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d1b34e58-7156-4590-a401-df64c8337e63 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:21.144983 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d1b34e58-7156-4590-a401-df64c8337e63 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.145740 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d1b34e58-7156-4590-a401-df64c8337e63 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:21.231271 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d1b34e58-7156-4590-a401-df64c8337e63 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:21.244100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d1b34e58-7156-4590-a401-df64c8337e63 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1471 microversion: 2.1 time: 0.124929 Jun 21 15:58:21.244924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 301/588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:21 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1471 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:21.248078 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-dadb35d3-3ef0-413a-862f-a04edb22bd1f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:21.256598 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dadb35d3-3ef0-413a-862f-a04edb22bd1f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1365 microversion: 2.1 time: 0.215902 Jun 21 15:58:21.266698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 288/589] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:21 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:21.672595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9b75684d-8249-4e23-9a69-6dd04f3aa6df tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:21.673189 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9b75684d-8249-4e23-9a69-6dd04f3aa6df tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:21.680487 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9b75684d-8249-4e23-9a69-6dd04f3aa6df tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.680936 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9b75684d-8249-4e23-9a69-6dd04f3aa6df tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:21.681702 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9b75684d-8249-4e23-9a69-6dd04f3aa6df tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.682168 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9b75684d-8249-4e23-9a69-6dd04f3aa6df tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:21.857176 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9b75684d-8249-4e23-9a69-6dd04f3aa6df tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:21.871149 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9b75684d-8249-4e23-9a69-6dd04f3aa6df tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1723 microversion: 2.1 time: 0.203160 Jun 21 15:58:21.881455 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 302/590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:21 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:21.918838 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:21.919443 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:21.933505 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.933994 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:21.934777 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:21.935225 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.000346 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-cc36742c-c266-4662-b730-cc0ea474b55e req-d44da9b2-37bc-43fd-b988-913af8c345c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899aef0a-2cf7-47b2-9b08-0068bde58dae", "name": "network-vif-unplugged", "status": "completed", "tag": "6288bac4-2f2c-42ad-9eca-74ece6209900"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:22.013215 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-cc36742c-c266-4662-b730-cc0ea474b55e req-d44da9b2-37bc-43fd-b988-913af8c345c1 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.013696 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-cc36742c-c266-4662-b730-cc0ea474b55e req-d44da9b2-37bc-43fd-b988-913af8c345c1 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.027264 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-cc36742c-c266-4662-b730-cc0ea474b55e req-d44da9b2-37bc-43fd-b988-913af8c345c1 service nova] Creating event network-vif-unplugged:6288bac4-2f2c-42ad-9eca-74ece6209900 for instance 899aef0a-2cf7-47b2-9b08-0068bde58dae on hv-cinder-84067 Jun 21 15:58:22.032932 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-cc36742c-c266-4662-b730-cc0ea474b55e req-d44da9b2-37bc-43fd-b988-913af8c345c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036759 Jun 21 15:58:22.033532 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 303/591] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:22.084635 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:22.093720 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:22.095266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:22.096481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3bb8cd76-430c-4364-901e-66f4e6a8130f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1724 microversion: 2.20 time: 0.182304 Jun 21 15:58:22.097079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 289/592] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:21 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:22.118951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-725c11b6-c877-4afa-a58e-d72202f13a54 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b4e314a-a232-44af-824c-a33610fee542"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:22.120194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-725c11b6-c877-4afa-a58e-d72202f13a54 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:22.126647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-725c11b6-c877-4afa-a58e-d72202f13a54 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.127090 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-725c11b6-c877-4afa-a58e-d72202f13a54 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.127881 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-725c11b6-c877-4afa-a58e-d72202f13a54 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.128481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-725c11b6-c877-4afa-a58e-d72202f13a54 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.261100 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:22.261962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:22.268168 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.268591 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.269577 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.270034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.307111 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.307546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.307984 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lazy-loading 'fault' on Instance uuid b51b581b-07bc-41e2-9dfb-1db8bf770e8d {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 15:58:22.353372 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:22.376785 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4174d7f9-0c76-4042-a245-ad5d69a508a0 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 200 len: 1309 microversion: 2.1 time: 0.119456 Jun 21 15:58:22.380479 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 290/593] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:22 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 15:58:22.389414 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a10f23f5-6dd3-4dd4-9509-bc289963ad83 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:22.391100 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a10f23f5-6dd3-4dd4-9509-bc289963ad83 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:22.400851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a10f23f5-6dd3-4dd4-9509-bc289963ad83 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.401637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a10f23f5-6dd3-4dd4-9509-bc289963ad83 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.402802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a10f23f5-6dd3-4dd4-9509-bc289963ad83 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.403298 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a10f23f5-6dd3-4dd4-9509-bc289963ad83 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.493692 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-725c11b6-c877-4afa-a58e-d72202f13a54 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.381317 Jun 21 15:58:22.494608 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 304/594] 10.222.0.52 () {62 vars in 1363 bytes} [Tue Jun 21 15:58:22 2022] POST /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments => generated 188 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 15:58:22.612985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a10f23f5-6dd3-4dd4-9509-bc289963ad83 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:22.621704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a10f23f5-6dd3-4dd4-9509-bc289963ad83 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1554 microversion: 2.1 time: 0.240033 Jun 21 15:58:22.622705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 291/595] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:22 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:22.644090 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-170b06a0-5b2a-4229-8a99-abbae01fd653 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:22.644090 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-170b06a0-5b2a-4229-8a99-abbae01fd653 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:22.654093 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-170b06a0-5b2a-4229-8a99-abbae01fd653 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.658492 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-170b06a0-5b2a-4229-8a99-abbae01fd653 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.659592 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-170b06a0-5b2a-4229-8a99-abbae01fd653 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.660180 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-170b06a0-5b2a-4229-8a99-abbae01fd653 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.680827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-63a206f3-1546-4f8c-9530-e8778a49f02d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:22.681439 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-63a206f3-1546-4f8c-9530-e8778a49f02d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:22.690478 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-63a206f3-1546-4f8c-9530-e8778a49f02d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.691746 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-63a206f3-1546-4f8c-9530-e8778a49f02d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.692869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-63a206f3-1546-4f8c-9530-e8778a49f02d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.693476 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-63a206f3-1546-4f8c-9530-e8778a49f02d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.799029 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-170b06a0-5b2a-4229-8a99-abbae01fd653 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160291 Jun 21 15:58:22.799959 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 305/596] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jun 21 15:58:22 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:22.829004 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-63a206f3-1546-4f8c-9530-e8778a49f02d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/action" status: 202 len: 0 microversion: 2.20 time: 0.152880 Jun 21 15:58:22.829825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 292/597] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jun 21 15:58:22 2022] POST /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 15:58:22.839646 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:22.839974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:22.846830 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.847270 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.848026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.848500 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.888434 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-51db3802-8223-4dad-922e-3c60987a86cd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:22.889034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-51db3802-8223-4dad-922e-3c60987a86cd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:22.891081 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:22.896623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51db3802-8223-4dad-922e-3c60987a86cd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.897181 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51db3802-8223-4dad-922e-3c60987a86cd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:22.898072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51db3802-8223-4dad-922e-3c60987a86cd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:22.898614 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51db3802-8223-4dad-922e-3c60987a86cd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:23.607568 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:23.617234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-51db3802-8223-4dad-922e-3c60987a86cd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:23.623328 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:23.626672 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:23.628769 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9c33e4ad-936b-4906-b70c-8035678c20ba tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1750 microversion: 2.20 time: 0.794859 Jun 21 15:58:23.629430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 306/598] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:22 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1750 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:58:23.634654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:23.635295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: b51b581b-07bc-41e2-9dfb-1db8bf770e8d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:23.636685 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-51db3802-8223-4dad-922e-3c60987a86cd tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1700 microversion: 2.1 time: 0.752054 Jun 21 15:58:23.637433 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 293/599] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:22 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1700 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:23.644918 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:23.645426 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:23.646168 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:23.646771 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:23.662622 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2d6c9969-f9b9-439f-b074-14e2eb12ded1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:23.671256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d6c9969-f9b9-439f-b074-14e2eb12ded1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:23.671820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d6c9969-f9b9-439f-b074-14e2eb12ded1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:23.682984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] HTTP exception thrown: Instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d could not be found. Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Request method failure captured: Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d HTTP/1.1 Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABiseowcirefqgrsThTOTQ4hpHTP5ZDrd93RlX-N97DkbLV7lxbtK3hHDdAoA-CjHGtuMalLxhEtLDfqffVE_UW0epTlRSnGVDA7Iw_aGGl2E3QW9jCrbf8ORuxXgmu6f0soXXUkr1sqLvzyXR6EdCyzhNt8nd6Eso006Hf_fcmRrVW6xI Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: af3eba9c8dda4166accce40c556af46e Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-VolumesSnapshotTestJSON-228925538 Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 15:58:23.684991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af3eba9c8dda4166accce40c556af46e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af3eba9c8dda4166accce40c556af46e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af3eba9c8dda4166accce40c556af46e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af3eba9c8dda4166accce40c556af46e", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-VolumesSnapshotTestJSON-228925538 Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: af3eba9c8dda4166accce40c556af46e Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-228925538 Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-VolumesSnapshotTestJSON-228925538-project Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 32512d9ebcc8447a88b99da4181895e7 Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-VolumesSnapshotTestJSON-228925538-project Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d could not be found. Jun 21 15:58:23.686698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'b51b581b-07bc-41e2-9dfb-1db8bf770e8d'} Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d could not be found. Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:58:23.687778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d could not be found. Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d could not be found. Jun 21 15:58:23.689280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:58:23.690679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Returning 404 to user: Instance b51b581b-07bc-41e2-9dfb-1db8bf770e8d could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:58:23.691556 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b37df34d-3786-4afd-a7e0-2a93954d1d47 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d" status: 404 len: 111 microversion: 2.1 time: 0.060949 Jun 21 15:58:23.692463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 307/600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:23 2022] GET /compute/v2.1/servers/b51b581b-07bc-41e2-9dfb-1db8bf770e8d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 15:58:23.700651 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2d6c9969-f9b9-439f-b074-14e2eb12ded1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Going to try to start instance {{(pid=123939) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 15:58:23.769037 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2d6c9969-f9b9-439f-b074-14e2eb12ded1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/action" status: 202 len: 0 microversion: 2.1 time: 0.110106 Jun 21 15:58:23.770607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 294/601] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 15:58:23 2022] POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 15:58:23.782450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4cf5ea1b-6376-46e9-80df-91b915456eb0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:23.783411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4cf5ea1b-6376-46e9-80df-91b915456eb0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:23.792699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4cf5ea1b-6376-46e9-80df-91b915456eb0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:23.793570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4cf5ea1b-6376-46e9-80df-91b915456eb0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:23.794467 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4cf5ea1b-6376-46e9-80df-91b915456eb0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:23.795469 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4cf5ea1b-6376-46e9-80df-91b915456eb0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:24.175556 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4cf5ea1b-6376-46e9-80df-91b915456eb0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:24.185227 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4cf5ea1b-6376-46e9-80df-91b915456eb0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1709 microversion: 2.1 time: 0.409164 Jun 21 15:58:24.186163 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 308/602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:23 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1709 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:24.649024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:24.649730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:24.657841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:24.658207 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:24.658979 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:24.659404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:24.972975 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:24.982519 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:24.983982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:24.985387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b64da966-7046-4f3b-90c5-3ec2b7c2f3bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1752 microversion: 2.20 time: 0.341526 Jun 21 15:58:24.986465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 295/603] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:24 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1752 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:25.026130 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-ae4c1e90-b691-46ef-9b40-d5a9f714c827 req-8b3a0469-2064-4acf-a1ee-85e9508f652f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e069614-4aff-4e07-841c-31317d94f447", "tag": "11038423-70d0-440b-b68d-35bfa6a0d923"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:25.035729 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-ae4c1e90-b691-46ef-9b40-d5a9f714c827 req-8b3a0469-2064-4acf-a1ee-85e9508f652f service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:25.036162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-ae4c1e90-b691-46ef-9b40-d5a9f714c827 req-8b3a0469-2064-4acf-a1ee-85e9508f652f service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:25.047715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-ae4c1e90-b691-46ef-9b40-d5a9f714c827 req-8b3a0469-2064-4acf-a1ee-85e9508f652f service nova] Creating event network-changed:11038423-70d0-440b-b68d-35bfa6a0d923 for instance 8e069614-4aff-4e07-841c-31317d94f447 on hv-cinder-84067 Jun 21 15:58:25.052887 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-ae4c1e90-b691-46ef-9b40-d5a9f714c827 req-8b3a0469-2064-4acf-a1ee-85e9508f652f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032357 Jun 21 15:58:25.053623 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 309/604] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:25.203932 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-29a0b2ea-8251-4397-9a38-1ea45e8e74d2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:25.204525 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-29a0b2ea-8251-4397-9a38-1ea45e8e74d2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:25.212052 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29a0b2ea-8251-4397-9a38-1ea45e8e74d2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:25.212500 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29a0b2ea-8251-4397-9a38-1ea45e8e74d2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:25.213361 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29a0b2ea-8251-4397-9a38-1ea45e8e74d2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:25.213990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29a0b2ea-8251-4397-9a38-1ea45e8e74d2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:25.354568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-29a0b2ea-8251-4397-9a38-1ea45e8e74d2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:25.362744 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-29a0b2ea-8251-4397-9a38-1ea45e8e74d2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1709 microversion: 2.1 time: 0.162858 Jun 21 15:58:25.363309 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 296/605] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:25 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:26.009285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:26.010056 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:26.016725 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:26.017169 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:26.017971 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:26.018399 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:26.179969 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:26.189462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:26.191006 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:26.192204 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8c20a4e9-c505-4d3a-bc91-7354b3e6d870 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1752 microversion: 2.20 time: 0.187725 Jun 21 15:58:26.192775 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 310/606] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:26 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:26.379981 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-793f82e8-9253-4fe3-959a-1854c055c1c4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:26.380525 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-793f82e8-9253-4fe3-959a-1854c055c1c4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:26.387777 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-793f82e8-9253-4fe3-959a-1854c055c1c4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:26.388221 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-793f82e8-9253-4fe3-959a-1854c055c1c4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:26.389005 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-793f82e8-9253-4fe3-959a-1854c055c1c4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:26.389440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-793f82e8-9253-4fe3-959a-1854c055c1c4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:26.393578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:26.584841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-793f82e8-9253-4fe3-959a-1854c055c1c4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:26.595630 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-793f82e8-9253-4fe3-959a-1854c055c1c4 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1709 microversion: 2.1 time: 0.219420 Jun 21 15:58:26.596349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 297/607] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:26 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1709 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:27.210684 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:27.211383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:27.218895 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:27.219345 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:27.220252 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:27.220540 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:27.360680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:27.369934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:27.371436 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:27.372612 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5e69c435-b6bc-442d-85c6-23bd2ee36790 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1752 microversion: 2.20 time: 0.166246 Jun 21 15:58:27.373179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 311/608] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:27 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:27.617878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-61276913-3f83-4909-9793-a9d1e9d1ca25 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:27.618468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-61276913-3f83-4909-9793-a9d1e9d1ca25 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:27.625337 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-61276913-3f83-4909-9793-a9d1e9d1ca25 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:27.625805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-61276913-3f83-4909-9793-a9d1e9d1ca25 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:27.626552 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-61276913-3f83-4909-9793-a9d1e9d1ca25 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:27.626969 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-61276913-3f83-4909-9793-a9d1e9d1ca25 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:27.762065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-61276913-3f83-4909-9793-a9d1e9d1ca25 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:27.770245 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-61276913-3f83-4909-9793-a9d1e9d1ca25 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1709 microversion: 2.1 time: 0.158670 Jun 21 15:58:27.770806 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 298/609] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:27 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:28.396449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:28.397528 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:28.404769 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:28.405230 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:28.406065 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:28.406501 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:28.788245 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c5f94df9-8b5a-46b6-a221-d58b431fea81 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:28.789043 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c5f94df9-8b5a-46b6-a221-d58b431fea81 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:28.797015 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c5f94df9-8b5a-46b6-a221-d58b431fea81 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:28.797440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c5f94df9-8b5a-46b6-a221-d58b431fea81 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:28.798246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c5f94df9-8b5a-46b6-a221-d58b431fea81 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:28.798686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c5f94df9-8b5a-46b6-a221-d58b431fea81 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:28.979350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:28.989864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:28.991592 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:28.993476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-31380045-9d11-4086-b0fe-70284f2982b9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1752 microversion: 2.20 time: 0.603344 Jun 21 15:58:28.993650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 312/610] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:28 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1752 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:29.035577 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c5f94df9-8b5a-46b6-a221-d58b431fea81 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:29.044197 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c5f94df9-8b5a-46b6-a221-d58b431fea81 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1709 microversion: 2.1 time: 0.259986 Jun 21 15:58:29.044722 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 299/611] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:28 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1709 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:30.012374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:30.012952 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:30.020207 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:30.020650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:30.021405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:30.022005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:30.061676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dcc7dfbb-7567-4bb5-af48-7c939a087957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:30.062815 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dcc7dfbb-7567-4bb5-af48-7c939a087957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:30.073842 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dcc7dfbb-7567-4bb5-af48-7c939a087957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:30.074209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dcc7dfbb-7567-4bb5-af48-7c939a087957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:30.074952 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dcc7dfbb-7567-4bb5-af48-7c939a087957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:30.075381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dcc7dfbb-7567-4bb5-af48-7c939a087957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:30.278830 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:30.289272 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:30.290807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:30.291991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-12a62890-1f2a-4fa9-b23d-dd3d33996977 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.283704 Jun 21 15:58:30.292559 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 313/612] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:30 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:30.333480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-dcc7dfbb-7567-4bb5-af48-7c939a087957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:30.342869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dcc7dfbb-7567-4bb5-af48-7c939a087957 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1713 microversion: 2.1 time: 0.285061 Jun 21 15:58:30.343440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 300/613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:30 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1713 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:31.310725 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:31.311357 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:31.319077 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:31.319532 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:31.320305 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:31.320732 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:31.481662 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:31.491564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:31.492840 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:31.494063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-952c0249-8c4f-459b-8210-c18af12200e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.187294 Jun 21 15:58:31.494819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 314/614] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:31 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:32.513885 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:32.514457 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:32.522954 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:32.523437 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:32.524278 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:32.524749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:32.671568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:32.682617 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:32.684138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:32.685334 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5aff4b4a-d9f0-4b68-b543-4d85b61ecf9b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.176063 Jun 21 15:58:32.685939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 301/615] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:32 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:33.704810 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:33.705383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:33.712513 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:33.712957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:33.714278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:33.714673 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:33.860054 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:33.878878 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:33.878878 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:33.878878 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a50d53ca-1dc0-468c-a67b-bcf3e3a4fe5e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.176481 Jun 21 15:58:33.879420 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 315/616] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:33 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:34.900970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:34.901641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:34.908680 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:34.909394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:34.910346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:34.910917 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:35.061615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:35.070762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:35.072481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:35.073656 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ec2f4e5e-660a-48a8-aee5-222fd3874fbc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.177395 Jun 21 15:58:35.074246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 302/617] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:34 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:36.093411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:36.094552 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:36.100946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:36.101387 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:36.102217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:36.102864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:36.245712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:36.248114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:36.258111 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:36.266939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:36.268150 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-04d4217a-659e-42ff-9fe7-e72db6eaf958 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.178599 Jun 21 15:58:36.268752 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 316/618] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:36 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:37.232244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-911324398", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "networks": [{"uuid": "cb13e47c-97e9-450a-a349-4a483a8e0968"}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:37.288672 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:37.289637 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:37.294398 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] validate_networks() for [('cb13e47c-97e9-450a-a349-4a483a8e0968', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 15:58:37.299455 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:37.300138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:37.301150 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:37.301707 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:37.544846 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:37.554260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:37.555976 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:37.557335 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ebb7c17d-c0bc-4d30-90d9-6bd06b32aea3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.273858 Jun 21 15:58:37.580588 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 317/619] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:37 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:37.765317 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 15:58:37.765793 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 15:58:37.766286 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 15:58:37.766676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 15:58:37.767119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 15:58:37.777601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:37.778488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:37.779737 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:37.780177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:37.798946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Getting quotas for project af3eba9c8dda4166accce40c556af46e. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 15:58:37.803318 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Getting quotas for user 32512d9ebcc8447a88b99da4181895e7 and project af3eba9c8dda4166accce40c556af46e. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 15:58:37.816304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 15:58:37.818658 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 15:58:37.875186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e6c087c3-7dbc-48f5-8b63-38cdad74dde3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646630 Jun 21 15:58:37.875816 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 303/620] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 15:58:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 15:58:37.886283 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-26cd9d21-5a85-4d10-aa27-1d676677e037 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:37.886893 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-26cd9d21-5a85-4d10-aa27-1d676677e037 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:37.959849 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-26cd9d21-5a85-4d10-aa27-1d676677e037 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:37.969090 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-26cd9d21-5a85-4d10-aa27-1d676677e037 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1218 microversion: 2.1 time: 0.086992 Jun 21 15:58:37.969843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 318/621] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:37 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:38.589555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:38.591141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:38.599069 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:38.599501 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:38.600263 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:38.600895 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:38.742607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:38.754174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:38.755683 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:38.756870 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1615d4c3-1027-44b9-99e6-b13ed85b623b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.172234 Jun 21 15:58:38.757421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 304/622] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:38 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:38.986831 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f3c5f0a4-ad4e-452a-b7fb-7c228469367e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:38.987489 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f3c5f0a4-ad4e-452a-b7fb-7c228469367e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:38.994787 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3c5f0a4-ad4e-452a-b7fb-7c228469367e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:38.995234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3c5f0a4-ad4e-452a-b7fb-7c228469367e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:38.995992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3c5f0a4-ad4e-452a-b7fb-7c228469367e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:38.996403 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3c5f0a4-ad4e-452a-b7fb-7c228469367e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:39.063656 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f3c5f0a4-ad4e-452a-b7fb-7c228469367e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:39.071995 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f3c5f0a4-ad4e-452a-b7fb-7c228469367e tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.089058 Jun 21 15:58:39.072618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 319/623] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:38 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:39.778366 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:39.778366 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:39.785689 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:39.786161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:39.786926 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:39.787350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:39.929994 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:39.939435 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:39.940959 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:39.942153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b05054d8-d775-4233-9566-8fbe777e3168 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.169277 Jun 21 15:58:39.942678 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 305/624] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:39 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:40.090254 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e66e2f27-b0ae-406d-b7c9-04b056243def tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:40.090868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e66e2f27-b0ae-406d-b7c9-04b056243def tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:40.100502 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e66e2f27-b0ae-406d-b7c9-04b056243def tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:40.101034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e66e2f27-b0ae-406d-b7c9-04b056243def tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:40.102989 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e66e2f27-b0ae-406d-b7c9-04b056243def tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:40.103210 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e66e2f27-b0ae-406d-b7c9-04b056243def tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:40.169295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e66e2f27-b0ae-406d-b7c9-04b056243def tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:40.177006 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e66e2f27-b0ae-406d-b7c9-04b056243def tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.092225 Jun 21 15:58:40.177575 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 320/625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:40 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:40.960673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:40.961333 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:40.968382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:40.968827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:40.969585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:40.970086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:41.114935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:41.124243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:41.125760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:41.126996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-994fe9b7-7433-4662-af4e-aadb7991a4a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.170256 Jun 21 15:58:41.127666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 306/626] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:40 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:41.194216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-57701003-b21c-4ab3-ad43-82388bc83ba2 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:41.194842 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-57701003-b21c-4ab3-ad43-82388bc83ba2 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:41.202026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57701003-b21c-4ab3-ad43-82388bc83ba2 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:41.202477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57701003-b21c-4ab3-ad43-82388bc83ba2 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:41.203244 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57701003-b21c-4ab3-ad43-82388bc83ba2 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:41.203677 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57701003-b21c-4ab3-ad43-82388bc83ba2 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:41.269548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-57701003-b21c-4ab3-ad43-82388bc83ba2 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:41.279375 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-57701003-b21c-4ab3-ad43-82388bc83ba2 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.089032 Jun 21 15:58:41.280185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 321/627] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:41 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:42.147706 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:42.148401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:42.155790 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:42.156378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:42.157225 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:42.157655 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:42.297176 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9eedf6c7-8e64-4dc2-87e8-11083122570a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:42.297766 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9eedf6c7-8e64-4dc2-87e8-11083122570a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:42.304682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9eedf6c7-8e64-4dc2-87e8-11083122570a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:42.305335 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9eedf6c7-8e64-4dc2-87e8-11083122570a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:42.305919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9eedf6c7-8e64-4dc2-87e8-11083122570a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:42.306357 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9eedf6c7-8e64-4dc2-87e8-11083122570a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:42.313985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:42.323087 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:42.325519 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:42.325938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fa9efa82-e011-4211-bc8f-76078962e035 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.184314 Jun 21 15:58:42.326426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 307/628] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:42 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:42.375248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9eedf6c7-8e64-4dc2-87e8-11083122570a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:42.383139 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9eedf6c7-8e64-4dc2-87e8-11083122570a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.089829 Jun 21 15:58:42.384608 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 322/629] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:42 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:43.348149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:43.348872 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:43.356499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:43.356937 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:43.357704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:43.358176 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:43.401102 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2c114855-3064-4fb4-a72e-49a8f0e547d5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:43.402027 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2c114855-3064-4fb4-a72e-49a8f0e547d5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:43.409144 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c114855-3064-4fb4-a72e-49a8f0e547d5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:43.409691 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c114855-3064-4fb4-a72e-49a8f0e547d5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:43.410538 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c114855-3064-4fb4-a72e-49a8f0e547d5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:43.411229 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c114855-3064-4fb4-a72e-49a8f0e547d5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:43.481664 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2c114855-3064-4fb4-a72e-49a8f0e547d5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:43.489734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2c114855-3064-4fb4-a72e-49a8f0e547d5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.092980 Jun 21 15:58:43.490705 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 323/630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:43 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:43.543804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:43.557018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:43.558564 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:43.559716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-57632949-98bc-41b7-bbd1-345be551f696 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.215579 Jun 21 15:58:43.560574 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 308/631] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:43 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:44.507939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7f3ad0fd-9255-42c1-aae9-2b61e549be1c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:44.508572 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7f3ad0fd-9255-42c1-aae9-2b61e549be1c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:44.511533 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:44.516744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7f3ad0fd-9255-42c1-aae9-2b61e549be1c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:44.517183 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7f3ad0fd-9255-42c1-aae9-2b61e549be1c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:44.517997 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7f3ad0fd-9255-42c1-aae9-2b61e549be1c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:44.518422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7f3ad0fd-9255-42c1-aae9-2b61e549be1c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:44.578427 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:44.579046 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:44.584603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7f3ad0fd-9255-42c1-aae9-2b61e549be1c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:44.585940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:44.586344 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:44.587109 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:44.588018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:44.593067 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7f3ad0fd-9255-42c1-aae9-2b61e549be1c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.089093 Jun 21 15:58:44.593899 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 324/632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:44 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:44.731976 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:44.740705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:44.742173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:44.743355 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c86d6a33-e7b4-45f9-b441-557557a83c2b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.169041 Jun 21 15:58:44.743914 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 309/633] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:44 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 15:58:45.611971 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3b734457-887c-4279-8a87-1051c11fa8a8 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:45.612569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3b734457-887c-4279-8a87-1051c11fa8a8 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:45.619279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3b734457-887c-4279-8a87-1051c11fa8a8 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:45.619800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3b734457-887c-4279-8a87-1051c11fa8a8 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:45.620589 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3b734457-887c-4279-8a87-1051c11fa8a8 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:45.620983 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3b734457-887c-4279-8a87-1051c11fa8a8 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:45.694301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3b734457-887c-4279-8a87-1051c11fa8a8 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:45.702605 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3b734457-887c-4279-8a87-1051c11fa8a8 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.095554 Jun 21 15:58:45.712416 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 325/634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:45 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:45.762171 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:45.763729 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:45.774666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:45.775110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:45.775888 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:45.776312 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:45.921462 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:45.930927 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:45.932420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:45.933626 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-724ed679-4b7c-4490-ba38-c97fee205698 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.175779 Jun 21 15:58:45.934242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 310/635] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:45 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:46.722669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1ac0fecc-6cc0-46dc-97ee-3f5b834a41f5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:46.723300 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1ac0fecc-6cc0-46dc-97ee-3f5b834a41f5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:46.733327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ac0fecc-6cc0-46dc-97ee-3f5b834a41f5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:46.733818 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ac0fecc-6cc0-46dc-97ee-3f5b834a41f5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:46.734593 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ac0fecc-6cc0-46dc-97ee-3f5b834a41f5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:46.735030 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ac0fecc-6cc0-46dc-97ee-3f5b834a41f5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:46.806376 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1ac0fecc-6cc0-46dc-97ee-3f5b834a41f5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:46.814986 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1ac0fecc-6cc0-46dc-97ee-3f5b834a41f5 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.098415 Jun 21 15:58:46.815560 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 326/636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:46 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:46.952926 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:46.953557 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:46.961006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:46.961508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:46.962766 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:46.963260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:47.106041 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:47.119353 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:47.121666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:47.123519 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-58601a01-0bd3-4ce7-9627-f790be0b23f4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.174257 Jun 21 15:58:47.124155 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 311/637] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:46 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:47.832121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8402d8a5-c617-417e-9d87-092f3f13b537 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:47.832732 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8402d8a5-c617-417e-9d87-092f3f13b537 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:47.840227 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8402d8a5-c617-417e-9d87-092f3f13b537 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:47.840664 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8402d8a5-c617-417e-9d87-092f3f13b537 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:47.841578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8402d8a5-c617-417e-9d87-092f3f13b537 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:47.842587 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8402d8a5-c617-417e-9d87-092f3f13b537 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:47.915906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8402d8a5-c617-417e-9d87-092f3f13b537 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:47.927353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8402d8a5-c617-417e-9d87-092f3f13b537 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.098791 Jun 21 15:58:47.928154 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 327/638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:47 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:48.143336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:48.143900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:48.145761 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:48.146475 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=6 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:48.152766 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:48.153213 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:48.154032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:48.154467 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:48.293934 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:48.303633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:48.305156 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:48.306355 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-21cd2358-d74e-4e0b-81c1-ab9c28a695e7 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.167240 Jun 21 15:58:48.306928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 312/639] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:48 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:48.947699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-810105a7-abd7-4317-9e73-e5f9010da8ed tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:48.948285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-810105a7-abd7-4317-9e73-e5f9010da8ed tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:48.950138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:48.958724 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-810105a7-abd7-4317-9e73-e5f9010da8ed tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:48.959284 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-810105a7-abd7-4317-9e73-e5f9010da8ed tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:48.960320 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-810105a7-abd7-4317-9e73-e5f9010da8ed tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:48.960921 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-810105a7-abd7-4317-9e73-e5f9010da8ed tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:49.034129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-810105a7-abd7-4317-9e73-e5f9010da8ed tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:49.047822 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-810105a7-abd7-4317-9e73-e5f9010da8ed tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.102946 Jun 21 15:58:49.049343 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 328/640] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:48 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:49.447289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:49.447911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:49.454195 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:49.454625 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:49.455360 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:49.455776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:49.594346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:49.602993 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:49.604458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:49.605597 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f4b19e66-c65b-4083-bbb9-5829127bc600 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.284582 Jun 21 15:58:49.606188 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 313/641] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:49 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:50.067855 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b57d44e7-ffb1-4bc5-b36a-b12ab427f3e6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:50.068457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b57d44e7-ffb1-4bc5-b36a-b12ab427f3e6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:50.075375 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b57d44e7-ffb1-4bc5-b36a-b12ab427f3e6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:50.075940 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b57d44e7-ffb1-4bc5-b36a-b12ab427f3e6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:50.077220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b57d44e7-ffb1-4bc5-b36a-b12ab427f3e6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:50.077656 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b57d44e7-ffb1-4bc5-b36a-b12ab427f3e6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:50.152083 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b57d44e7-ffb1-4bc5-b36a-b12ab427f3e6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:50.160630 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b57d44e7-ffb1-4bc5-b36a-b12ab427f3e6 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.096588 Jun 21 15:58:50.161208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 329/642] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:50 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:50.628361 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:50.629096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:50.639932 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:50.640377 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:50.641144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:50.641567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:50.664344 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:50.799989 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:50.808863 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:50.810765 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:50.811761 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f4bbadff-46b0-4edf-b8d4-72e8eed3a0a3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.190087 Jun 21 15:58:50.812407 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 314/643] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:50 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:51.178501 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a0367d38-c2d6-4f62-a5ed-ddbb7c10b0c7 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:51.179183 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a0367d38-c2d6-4f62-a5ed-ddbb7c10b0c7 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:51.187668 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a0367d38-c2d6-4f62-a5ed-ddbb7c10b0c7 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:51.188191 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a0367d38-c2d6-4f62-a5ed-ddbb7c10b0c7 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:51.189072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a0367d38-c2d6-4f62-a5ed-ddbb7c10b0c7 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:51.189583 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a0367d38-c2d6-4f62-a5ed-ddbb7c10b0c7 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:51.256227 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a0367d38-c2d6-4f62-a5ed-ddbb7c10b0c7 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:51.264621 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a0367d38-c2d6-4f62-a5ed-ddbb7c10b0c7 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1222 microversion: 2.1 time: 0.090700 Jun 21 15:58:51.265474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 330/644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:51 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:51.831575 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:51.832204 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:51.839357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:51.839794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:51.840540 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:51.840955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:51.988164 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:51.996701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:51.998405 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:51.999578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-235c69dd-7791-4249-a6fb-137c77281512 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.172023 Jun 21 15:58:52.000148 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 315/645] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:51 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:52.280705 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e2db98d4-83c5-4765-81f7-f4462a05b84f tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:52.281569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e2db98d4-83c5-4765-81f7-f4462a05b84f tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:52.288080 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e2db98d4-83c5-4765-81f7-f4462a05b84f tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:52.288519 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e2db98d4-83c5-4765-81f7-f4462a05b84f tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:52.289269 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e2db98d4-83c5-4765-81f7-f4462a05b84f tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:52.289693 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e2db98d4-83c5-4765-81f7-f4462a05b84f tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:52.354736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e2db98d4-83c5-4765-81f7-f4462a05b84f tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:52.366370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e2db98d4-83c5-4765-81f7-f4462a05b84f tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1270 microversion: 2.1 time: 0.089407 Jun 21 15:58:52.367135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 331/646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:52 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:53.018892 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:53.020067 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:53.026105 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:53.027895 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:53.028420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:53.029402 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:53.029828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:53.178081 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:53.187400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:53.189069 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:53.190406 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0a1c12fa-184d-457d-b37d-5815a6bd4e94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.176007 Jun 21 15:58:53.191193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 316/647] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:53 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:53.386305 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-05f6bc2c-47bb-4c64-ab8a-b33f09312f8c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:53.386919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-05f6bc2c-47bb-4c64-ab8a-b33f09312f8c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:53.393864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05f6bc2c-47bb-4c64-ab8a-b33f09312f8c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:53.394342 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05f6bc2c-47bb-4c64-ab8a-b33f09312f8c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:53.395109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05f6bc2c-47bb-4c64-ab8a-b33f09312f8c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:53.395538 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05f6bc2c-47bb-4c64-ab8a-b33f09312f8c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:53.539099 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-05f6bc2c-47bb-4c64-ab8a-b33f09312f8c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:53.549827 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-05f6bc2c-47bb-4c64-ab8a-b33f09312f8c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.167192 Jun 21 15:58:53.550428 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 332/648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:53 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:54.209992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:54.210617 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:54.218575 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:54.219019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:54.219780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:54.220206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:54.359992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:54.368641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:54.370280 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:54.371376 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-cd5f35be-90e9-461c-94df-3ce8b6dbd347 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.165373 Jun 21 15:58:54.371912 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 317/649] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:54 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:54.466270 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-8c56726b-a62f-44e9-9ad9-31a5218c1a4a req-43819f26-4e4c-460a-bf71-9ddeca0ec79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8798ea33-4442-4776-a70a-cbdeceac78c6", "tag": "e6c6df60-934a-4c86-8142-0b98bb71e7f4"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:58:54.476336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-8c56726b-a62f-44e9-9ad9-31a5218c1a4a req-43819f26-4e4c-460a-bf71-9ddeca0ec79b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:54.476858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-8c56726b-a62f-44e9-9ad9-31a5218c1a4a req-43819f26-4e4c-460a-bf71-9ddeca0ec79b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:54.494683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-8c56726b-a62f-44e9-9ad9-31a5218c1a4a req-43819f26-4e4c-460a-bf71-9ddeca0ec79b service nova] Creating event network-changed:e6c6df60-934a-4c86-8142-0b98bb71e7f4 for instance 8798ea33-4442-4776-a70a-cbdeceac78c6 on hv-cinder-84067 Jun 21 15:58:54.501509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-8c56726b-a62f-44e9-9ad9-31a5218c1a4a req-43819f26-4e4c-460a-bf71-9ddeca0ec79b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039719 Jun 21 15:58:54.502488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 333/650] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:58:54.568087 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1976d611-4825-4d64-8b92-0430d7f35a30 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:54.568681 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1976d611-4825-4d64-8b92-0430d7f35a30 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:54.574908 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1976d611-4825-4d64-8b92-0430d7f35a30 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:54.575695 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1976d611-4825-4d64-8b92-0430d7f35a30 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:54.576892 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1976d611-4825-4d64-8b92-0430d7f35a30 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:54.577335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1976d611-4825-4d64-8b92-0430d7f35a30 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:54.727686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1976d611-4825-4d64-8b92-0430d7f35a30 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:54.735115 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1976d611-4825-4d64-8b92-0430d7f35a30 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.170932 Jun 21 15:58:54.735944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 318/651] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:54 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:55.391778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:55.392477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:55.399356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:55.399793 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:55.400555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:55.400977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:55.541333 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:55.552346 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:55.553819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:55.554987 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-27db1ab1-e7de-4565-9f9e-57aaddef9084 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.168372 Jun 21 15:58:55.555545 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 334/652] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:55 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:55.752900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d8582f40-ccf5-4042-860e-23bb1c3f939d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:55.753499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d8582f40-ccf5-4042-860e-23bb1c3f939d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:55.760711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d8582f40-ccf5-4042-860e-23bb1c3f939d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:55.761123 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d8582f40-ccf5-4042-860e-23bb1c3f939d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:55.761934 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d8582f40-ccf5-4042-860e-23bb1c3f939d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:55.762382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d8582f40-ccf5-4042-860e-23bb1c3f939d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:55.907732 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d8582f40-ccf5-4042-860e-23bb1c3f939d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:55.915847 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d8582f40-ccf5-4042-860e-23bb1c3f939d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.167436 Jun 21 15:58:55.916421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 319/653] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:55 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:56.578521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:56.579079 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:56.586106 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:56.586542 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:56.587607 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:56.588030 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:56.590668 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:58:56.738081 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:56.750408 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:56.751956 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:56.753143 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b2041476-6435-42fe-a13b-92e6111a6cd3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.180478 Jun 21 15:58:56.753680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 335/654] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:56 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:56.933072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-beac38a3-cee7-40e2-a421-86af82cfd8b3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:56.933634 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-beac38a3-cee7-40e2-a421-86af82cfd8b3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:56.941431 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-beac38a3-cee7-40e2-a421-86af82cfd8b3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:56.941906 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-beac38a3-cee7-40e2-a421-86af82cfd8b3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:56.942662 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-beac38a3-cee7-40e2-a421-86af82cfd8b3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:56.943088 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-beac38a3-cee7-40e2-a421-86af82cfd8b3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:57.077726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-beac38a3-cee7-40e2-a421-86af82cfd8b3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:57.086183 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-beac38a3-cee7-40e2-a421-86af82cfd8b3 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.157073 Jun 21 15:58:57.087101 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 320/655] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:56 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:57.775006 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:57.776041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:57.787198 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:57.787933 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:57.789178 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:57.789909 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:57.941605 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:57.954384 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:57.955735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:57.956920 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-854e5fd6-8432-4230-9668-fd81404fa34c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.188450 Jun 21 15:58:57.957481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 336/656] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:57 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:58.103532 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-eab1d9e3-f94a-431d-986b-8479de5fa04c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:58.104121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-eab1d9e3-f94a-431d-986b-8479de5fa04c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:58.111179 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eab1d9e3-f94a-431d-986b-8479de5fa04c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:58.111621 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eab1d9e3-f94a-431d-986b-8479de5fa04c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:58.112380 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eab1d9e3-f94a-431d-986b-8479de5fa04c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:58.112811 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eab1d9e3-f94a-431d-986b-8479de5fa04c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:58.251530 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-eab1d9e3-f94a-431d-986b-8479de5fa04c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:58.259411 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-eab1d9e3-f94a-431d-986b-8479de5fa04c tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.159796 Jun 21 15:58:58.260016 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 321/657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:58 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:58:58.982418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:58.983585 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:58.990697 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:58.991135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:58.991877 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:58.992275 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:59.277069 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e6366b21-5ed8-44c7-b8e5-fe9ad7d0be2b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:58:59.277677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e6366b21-5ed8-44c7-b8e5-fe9ad7d0be2b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:58:59.285232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6366b21-5ed8-44c7-b8e5-fe9ad7d0be2b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:59.285671 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6366b21-5ed8-44c7-b8e5-fe9ad7d0be2b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:59.286473 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6366b21-5ed8-44c7-b8e5-fe9ad7d0be2b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:58:59.286890 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6366b21-5ed8-44c7-b8e5-fe9ad7d0be2b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:58:59.398794 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:59.408892 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:59.410546 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:59.411789 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2be8a3d1-b0a4-49a9-afcb-b4184a78e5c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.433371 Jun 21 15:58:59.412420 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 337/658] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:58:58 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:58:59.443786 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e6366b21-5ed8-44c7-b8e5-fe9ad7d0be2b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:58:59.452395 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e6366b21-5ed8-44c7-b8e5-fe9ad7d0be2b tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.178662 Jun 21 15:58:59.452956 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 322/659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:58:59 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:00.436263 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:00.436803 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:00.444174 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:00.444618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:00.445377 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:00.445805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:00.469580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2799a0e4-45bf-4dc3-92cd-14060bb4294a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:00.470212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2799a0e4-45bf-4dc3-92cd-14060bb4294a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:00.477135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2799a0e4-45bf-4dc3-92cd-14060bb4294a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:00.477578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2799a0e4-45bf-4dc3-92cd-14060bb4294a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:00.478379 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2799a0e4-45bf-4dc3-92cd-14060bb4294a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:00.478805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2799a0e4-45bf-4dc3-92cd-14060bb4294a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:00.642311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:00.651177 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:00.652828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:00.654047 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5b63e96a-8250-49f7-829c-88e74fe5043f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.224802 Jun 21 15:59:00.657302 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 338/660] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:00 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:00.659046 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2799a0e4-45bf-4dc3-92cd-14060bb4294a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:00.666794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2799a0e4-45bf-4dc3-92cd-14060bb4294a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.201519 Jun 21 15:59:00.667338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 323/661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:00 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:01.672913 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:01.673514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:01.680587 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:01.681034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:01.681810 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:01.682249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:01.684233 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d950f49e-6dbe-4fa5-8eaf-4cf771fd8e34 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:01.684835 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d950f49e-6dbe-4fa5-8eaf-4cf771fd8e34 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:01.691846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d950f49e-6dbe-4fa5-8eaf-4cf771fd8e34 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:01.692293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d950f49e-6dbe-4fa5-8eaf-4cf771fd8e34 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:01.693077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d950f49e-6dbe-4fa5-8eaf-4cf771fd8e34 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:01.693510 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d950f49e-6dbe-4fa5-8eaf-4cf771fd8e34 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:01.878107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:01.881413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d950f49e-6dbe-4fa5-8eaf-4cf771fd8e34 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:01.887321 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:01.888814 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:01.889223 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d950f49e-6dbe-4fa5-8eaf-4cf771fd8e34 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.208846 Jun 21 15:59:01.890597 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 324/662] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:01 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:01.890736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7782b229-1e53-4278-9825-22f9ad31e893 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.221318 Jun 21 15:59:01.890736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 339/663] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:01 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:02.287527 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-1f578bf2-6a1a-4a75-bf0c-03c674007883 req-d8fdf3b0-8c5d-4c19-be78-de87d0099898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8798ea33-4442-4776-a70a-cbdeceac78c6", "name": "network-vif-plugged", "status": "completed", "tag": "e6c6df60-934a-4c86-8142-0b98bb71e7f4"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:59:02.295901 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-1f578bf2-6a1a-4a75-bf0c-03c674007883 req-d8fdf3b0-8c5d-4c19-be78-de87d0099898 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:02.296637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-1f578bf2-6a1a-4a75-bf0c-03c674007883 req-d8fdf3b0-8c5d-4c19-be78-de87d0099898 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:02.309528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-1f578bf2-6a1a-4a75-bf0c-03c674007883 req-d8fdf3b0-8c5d-4c19-be78-de87d0099898 service nova] Creating event network-vif-plugged:e6c6df60-934a-4c86-8142-0b98bb71e7f4 for instance 8798ea33-4442-4776-a70a-cbdeceac78c6 on hv-cinder-84067 Jun 21 15:59:02.314990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-1f578bf2-6a1a-4a75-bf0c-03c674007883 req-d8fdf3b0-8c5d-4c19-be78-de87d0099898 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031905 Jun 21 15:59:02.315715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 325/664] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:59:02.907441 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-bc0461af-9e37-4990-b1e7-b9a2c338e06d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:02.908027 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-bc0461af-9e37-4990-b1e7-b9a2c338e06d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:02.910183 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:02.913336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:02.914728 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bc0461af-9e37-4990-b1e7-b9a2c338e06d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:02.915175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bc0461af-9e37-4990-b1e7-b9a2c338e06d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:02.915946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bc0461af-9e37-4990-b1e7-b9a2c338e06d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:02.916375 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bc0461af-9e37-4990-b1e7-b9a2c338e06d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:02.916924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:02.917365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:02.918133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:02.918893 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:03.115825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bc0461af-9e37-4990-b1e7-b9a2c338e06d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:03.126243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-bc0461af-9e37-4990-b1e7-b9a2c338e06d tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.222745 Jun 21 15:59:03.126727 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:03.127091 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 340/665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:02 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:03.138332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:03.139887 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:03.141095 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d6452a3f-9f8b-49d3-9d6c-af9b99f8f7a1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.236177 Jun 21 15:59:03.141670 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 326/666] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:02 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:04.146735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a4bc8136-8c00-4bdf-95b2-f4675d93aa56 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:04.147319 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a4bc8136-8c00-4bdf-95b2-f4675d93aa56 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:04.155894 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a4bc8136-8c00-4bdf-95b2-f4675d93aa56 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:04.156338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a4bc8136-8c00-4bdf-95b2-f4675d93aa56 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:04.157132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a4bc8136-8c00-4bdf-95b2-f4675d93aa56 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:04.157695 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a4bc8136-8c00-4bdf-95b2-f4675d93aa56 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:04.160021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:04.160648 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:04.167378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:04.167816 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:04.168620 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:04.169097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:04.351670 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a4bc8136-8c00-4bdf-95b2-f4675d93aa56 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:04.359887 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a4bc8136-8c00-4bdf-95b2-f4675d93aa56 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1318 microversion: 2.1 time: 0.219606 Jun 21 15:59:04.360837 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 341/667] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:04 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:04.363763 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:04.374616 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:04.377498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:04.378687 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-09820c2f-6519-48dd-9662-d246f02ef0d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.223016 Jun 21 15:59:04.379243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 327/668] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:04 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:04.559524 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-6d8ba4da-99b8-4d91-b5e5-9debc2c026b5 req-7434112f-dce3-47b8-b00c-29b28f7a8373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899aef0a-2cf7-47b2-9b08-0068bde58dae", "name": "network-vif-plugged", "status": "completed", "tag": "6288bac4-2f2c-42ad-9eca-74ece6209900"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:59:04.568093 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-6d8ba4da-99b8-4d91-b5e5-9debc2c026b5 req-7434112f-dce3-47b8-b00c-29b28f7a8373 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:04.568535 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-6d8ba4da-99b8-4d91-b5e5-9debc2c026b5 req-7434112f-dce3-47b8-b00c-29b28f7a8373 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:04.583017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-6d8ba4da-99b8-4d91-b5e5-9debc2c026b5 req-7434112f-dce3-47b8-b00c-29b28f7a8373 service nova] Creating event network-vif-plugged:6288bac4-2f2c-42ad-9eca-74ece6209900 for instance 899aef0a-2cf7-47b2-9b08-0068bde58dae on hv-cinder-84067 Jun 21 15:59:04.588336 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-6d8ba4da-99b8-4d91-b5e5-9debc2c026b5 req-7434112f-dce3-47b8-b00c-29b28f7a8373 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032527 Jun 21 15:59:04.588899 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 342/669] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:59:05.378386 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bf62aa7a-55b9-4485-8b70-3114a21dab97 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:05.379065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bf62aa7a-55b9-4485-8b70-3114a21dab97 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:05.387174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bf62aa7a-55b9-4485-8b70-3114a21dab97 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:05.387693 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bf62aa7a-55b9-4485-8b70-3114a21dab97 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:05.388550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bf62aa7a-55b9-4485-8b70-3114a21dab97 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:05.389024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bf62aa7a-55b9-4485-8b70-3114a21dab97 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:05.398302 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:05.399031 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:05.405530 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:05.406012 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:05.406804 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:05.407239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:05.603129 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-bf62aa7a-55b9-4485-8b70-3114a21dab97 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:05.610750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:05.612110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bf62aa7a-55b9-4485-8b70-3114a21dab97 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1506 microversion: 2.1 time: 0.238282 Jun 21 15:59:05.612892 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 328/670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:05 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:05.619739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:05.621502 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:05.622724 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-84b13b86-1cc4-4144-8e97-e62dcff3031d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.229282 Jun 21 15:59:05.629087 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-843c9ccb-f8b8-4246-b623-a44900a92691 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78b72f43-9d62-46b7-bbf0-1943c6bcc51b", "device": "/dev/sdb"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:59:05.630212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-843c9ccb-f8b8-4246-b623-a44900a92691 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:05.633371 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 343/671] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:05 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:05.636401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-843c9ccb-f8b8-4246-b623-a44900a92691 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:05.636842 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-843c9ccb-f8b8-4246-b623-a44900a92691 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:05.637597 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-843c9ccb-f8b8-4246-b623-a44900a92691 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:05.638039 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-843c9ccb-f8b8-4246-b623-a44900a92691 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:06.447850 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-843c9ccb-f8b8-4246-b623-a44900a92691 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "POST /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.822890 Jun 21 15:59:06.448502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 329/672] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 15:59:05 2022] POST /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 15:59:06.641262 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:06.641996 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:06.649235 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:06.649684 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:06.650486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:06.650920 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:06.792488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:06.803033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:06.804582 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:06.805749 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-49b4fe39-2128-4f79-83d9-f2157b0859cd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.168534 Jun 21 15:59:06.806412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 344/673] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:06 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:07.825813 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:07.827118 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:07.838367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:07.838367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:07.838367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:07.838367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:07.858296 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:07.990873 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:07.999390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:08.000890 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:08.002301 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-418c1f6a-cb34-4b61-b506-2b0de6e27f1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.181286 Jun 21 15:59:08.003224 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 330/674] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:07 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:09.020694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:09.021383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:09.028954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:09.029399 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:09.030220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:09.030641 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:09.180482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:09.189158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:09.190887 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:09.192058 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-57aa31ad-f866-4dcf-ad78-4016b4a614a6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1808 microversion: 2.20 time: 0.175446 Jun 21 15:59:09.192624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 345/675] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:09 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:10.215355 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:10.216338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:10.225195 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:10.225643 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:10.226442 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:10.226875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:10.369350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:10.380166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:10.381664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:10.382862 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a0547162-29e5-4f8b-a25a-15ef1348c63c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1795 microversion: 2.20 time: 0.174578 Jun 21 15:59:10.383422 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 331/676] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 15:59:10 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1795 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 15:59:30.057715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2d3d6cb5-0e01-45b0-a8e1-8f45baab3158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:30.058405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2d3d6cb5-0e01-45b0-a8e1-8f45baab3158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:30.061035 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=43 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:30.061702 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=61 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:30.068498 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2d3d6cb5-0e01-45b0-a8e1-8f45baab3158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:30.068960 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2d3d6cb5-0e01-45b0-a8e1-8f45baab3158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:30.069738 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2d3d6cb5-0e01-45b0-a8e1-8f45baab3158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:30.070195 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2d3d6cb5-0e01-45b0-a8e1-8f45baab3158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:30.161501 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-2d3d6cb5-0e01-45b0-a8e1-8f45baab3158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lazy-loading 'services' on Instance uuid 8798ea33-4442-4776-a70a-cbdeceac78c6 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 15:59:30.243666 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2d3d6cb5-0e01-45b0-a8e1-8f45baab3158 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6/os-volume_attachments/78b72f43-9d62-46b7-bbf0-1943c6bcc51b" status: 202 len: 0 microversion: 2.1 time: 0.189884 Jun 21 15:59:30.244553 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 346/677] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 15:59:30 2022] DELETE /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6/os-volume_attachments/78b72f43-9d62-46b7-bbf0-1943c6bcc51b => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 15:59:31.372887 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-518105ab-2257-480a-aa93-f75e367f5eae tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:31.373470 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-518105ab-2257-480a-aa93-f75e367f5eae tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:31.376940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=31 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:31.377688 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=8 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:31.384687 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-518105ab-2257-480a-aa93-f75e367f5eae tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:31.385130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-518105ab-2257-480a-aa93-f75e367f5eae tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:31.385951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-518105ab-2257-480a-aa93-f75e367f5eae tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:31.386343 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-518105ab-2257-480a-aa93-f75e367f5eae tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:31.412445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-518105ab-2257-480a-aa93-f75e367f5eae tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 15:59:31.501691 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-518105ab-2257-480a-aa93-f75e367f5eae tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 204 len: 0 microversion: 2.1 time: 0.134792 Jun 21 15:59:31.502366 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 332/678] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 15:59:31 2022] DELETE /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 15:59:31.512039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4c0992ad-e531-4edc-bc76-19dea9880e6a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:31.513410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4c0992ad-e531-4edc-bc76-19dea9880e6a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:31.521838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4c0992ad-e531-4edc-bc76-19dea9880e6a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:31.522263 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4c0992ad-e531-4edc-bc76-19dea9880e6a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:31.523059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4c0992ad-e531-4edc-bc76-19dea9880e6a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:31.523488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4c0992ad-e531-4edc-bc76-19dea9880e6a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:31.662610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4c0992ad-e531-4edc-bc76-19dea9880e6a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:31.671599 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4c0992ad-e531-4edc-bc76-19dea9880e6a tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1512 microversion: 2.1 time: 0.164643 Jun 21 15:59:31.672198 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 347/679] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:31 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:32.692881 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0024b954-c92b-4fe9-bc52-71b538305139 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:32.693438 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0024b954-c92b-4fe9-bc52-71b538305139 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:32.700722 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0024b954-c92b-4fe9-bc52-71b538305139 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:32.701151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0024b954-c92b-4fe9-bc52-71b538305139 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:32.701972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0024b954-c92b-4fe9-bc52-71b538305139 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:32.702402 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0024b954-c92b-4fe9-bc52-71b538305139 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:32.841137 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0024b954-c92b-4fe9-bc52-71b538305139 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:32.849146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0024b954-c92b-4fe9-bc52-71b538305139 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1512 microversion: 2.1 time: 0.161203 Jun 21 15:59:32.849911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 333/680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:32 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:33.869404 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9e12a262-9aa1-4a18-8850-3860f19ab164 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:33.870448 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9e12a262-9aa1-4a18-8850-3860f19ab164 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:33.880998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9e12a262-9aa1-4a18-8850-3860f19ab164 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:33.881514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9e12a262-9aa1-4a18-8850-3860f19ab164 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:33.882426 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9e12a262-9aa1-4a18-8850-3860f19ab164 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:33.882953 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9e12a262-9aa1-4a18-8850-3860f19ab164 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:34.028874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9e12a262-9aa1-4a18-8850-3860f19ab164 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32512d9ebcc8447a88b99da4181895e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3eba9c8dda4166accce40c556af46e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 15:59:34.038371 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9e12a262-9aa1-4a18-8850-3860f19ab164 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 200 len: 1512 microversion: 2.1 time: 0.175072 Jun 21 15:59:34.039343 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 348/681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:33 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 15:59:34.497427 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-9327e29a-0a08-4480-8703-a1487d9abe75 req-4daea9ef-b56f-43ca-b6ca-141a48ee5781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8798ea33-4442-4776-a70a-cbdeceac78c6", "name": "network-vif-deleted", "tag": "e6c6df60-934a-4c86-8142-0b98bb71e7f4"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 15:59:34.507725 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-9327e29a-0a08-4480-8703-a1487d9abe75 req-4daea9ef-b56f-43ca-b6ca-141a48ee5781 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:34.508414 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-9327e29a-0a08-4480-8703-a1487d9abe75 req-4daea9ef-b56f-43ca-b6ca-141a48ee5781 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:34.521505 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-9327e29a-0a08-4480-8703-a1487d9abe75 req-4daea9ef-b56f-43ca-b6ca-141a48ee5781 service nova] Creating event network-vif-deleted:e6c6df60-934a-4c86-8142-0b98bb71e7f4 for instance 8798ea33-4442-4776-a70a-cbdeceac78c6 on hv-cinder-84067 Jun 21 15:59:34.526237 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-9327e29a-0a08-4480-8703-a1487d9abe75 req-4daea9ef-b56f-43ca-b6ca-141a48ee5781 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100318 Jun 21 15:59:34.526824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 334/682] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 15:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 15:59:35.056393 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 15:59:35.056982 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] [instance: 8798ea33-4442-4776-a70a-cbdeceac78c6] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 15:59:35.063430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:35.063871 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:35.064619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 15:59:35.065040 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 15:59:35.079653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] HTTP exception thrown: Instance 8798ea33-4442-4776-a70a-cbdeceac78c6 could not be found. Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Request method failure captured: Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 HTTP/1.1 Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABiseowcirefqgrsThTOTQ4hpHTP5ZDrd93RlX-N97DkbLV7lxbtK3hHDdAoA-CjHGtuMalLxhEtLDfqffVE_UW0epTlRSnGVDA7Iw_aGGl2E3QW9jCrbf8ORuxXgmu6f0soXXUkr1sqLvzyXR6EdCyzhNt8nd6Eso006Hf_fcmRrVW6xI Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: af3eba9c8dda4166accce40c556af46e Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-VolumesSnapshotTestJSON-228925538 Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 15:59:35.081386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af3eba9c8dda4166accce40c556af46e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af3eba9c8dda4166accce40c556af46e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af3eba9c8dda4166accce40c556af46e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af3eba9c8dda4166accce40c556af46e", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-VolumesSnapshotTestJSON-228925538 Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: af3eba9c8dda4166accce40c556af46e Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-228925538 Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-VolumesSnapshotTestJSON-228925538-project Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 32512d9ebcc8447a88b99da4181895e7 Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-VolumesSnapshotTestJSON-228925538-project Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 8798ea33-4442-4776-a70a-cbdeceac78c6 could not be found. Jun 21 15:59:35.083279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '8798ea33-4442-4776-a70a-cbdeceac78c6'} Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8798ea33-4442-4776-a70a-cbdeceac78c6 could not be found. Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 15:59:35.084482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8798ea33-4442-4776-a70a-cbdeceac78c6 could not be found. Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8798ea33-4442-4776-a70a-cbdeceac78c6 could not be found. Jun 21 15:59:35.085974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 15:59:35.087267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] Returning 404 to user: Instance 8798ea33-4442-4776-a70a-cbdeceac78c6 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 15:59:35.087267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7c9ff10e-44e7-434b-8684-b374889ac517 tempest-VolumesSnapshotTestJSON-228925538 tempest-VolumesSnapshotTestJSON-228925538-project] 10.222.0.52 "GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6" status: 404 len: 111 microversion: 2.1 time: 0.030669 Jun 21 15:59:35.087267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 349/683] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 15:59:35 2022] GET /compute/v2.1/servers/8798ea33-4442-4776-a70a-cbdeceac78c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:00:13.216365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fd7d49f1-8956-4d93-ba9f-db34d684debd tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:13.217741 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fd7d49f1-8956-4d93-ba9f-db34d684debd tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:13.221237 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:13.222008 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:13.232312 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fd7d49f1-8956-4d93-ba9f-db34d684debd tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:13.232940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fd7d49f1-8956-4d93-ba9f-db34d684debd tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:13.234184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fd7d49f1-8956-4d93-ba9f-db34d684debd tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:13.234615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fd7d49f1-8956-4d93-ba9f-db34d684debd tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:13.312288 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fd7d49f1-8956-4d93-ba9f-db34d684debd tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "POST /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/action" status: 202 len: 0 microversion: 2.1 time: 0.102867 Jun 21 16:00:13.315874 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 335/684] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 16:00:13 2022] POST /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:00:13.321162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ad9b915d-0a00-4e3e-b159-4b3674f02c49 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:13.321794 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ad9b915d-0a00-4e3e-b159-4b3674f02c49 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:13.324133 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=8 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:13.325029 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:13.331266 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ad9b915d-0a00-4e3e-b159-4b3674f02c49 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:13.331754 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ad9b915d-0a00-4e3e-b159-4b3674f02c49 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:13.332527 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ad9b915d-0a00-4e3e-b159-4b3674f02c49 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:13.333007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ad9b915d-0a00-4e3e-b159-4b3674f02c49 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:13.490110 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ad9b915d-0a00-4e3e-b159-4b3674f02c49 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:13.500258 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ad9b915d-0a00-4e3e-b159-4b3674f02c49 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1752 microversion: 2.1 time: 0.182963 Jun 21 16:00:13.500829 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 350/685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:13 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:14.521394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a5a05309-6cf0-4851-985c-7af9ce4e59cf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:14.522133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a5a05309-6cf0-4851-985c-7af9ce4e59cf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:14.529198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a5a05309-6cf0-4851-985c-7af9ce4e59cf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:14.529639 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a5a05309-6cf0-4851-985c-7af9ce4e59cf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:14.530427 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a5a05309-6cf0-4851-985c-7af9ce4e59cf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:14.530861 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a5a05309-6cf0-4851-985c-7af9ce4e59cf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:14.692234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a5a05309-6cf0-4851-985c-7af9ce4e59cf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:14.705636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a5a05309-6cf0-4851-985c-7af9ce4e59cf tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.188952 Jun 21 16:00:14.706413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 336/686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:14 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:15.732512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-08d61ff6-852a-4e9a-befc-64aea6fd86f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:15.733379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-08d61ff6-852a-4e9a-befc-64aea6fd86f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:15.744436 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-08d61ff6-852a-4e9a-befc-64aea6fd86f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:15.745154 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-08d61ff6-852a-4e9a-befc-64aea6fd86f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:15.746320 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-08d61ff6-852a-4e9a-befc-64aea6fd86f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:15.747716 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-08d61ff6-852a-4e9a-befc-64aea6fd86f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:15.922678 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-08d61ff6-852a-4e9a-befc-64aea6fd86f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:15.932081 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-08d61ff6-852a-4e9a-befc-64aea6fd86f3 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.205768 Jun 21 16:00:15.932999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 351/687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:15 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:16.954609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d28f8966-32bc-40a1-891c-2a10ebeacf47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:16.955683 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d28f8966-32bc-40a1-891c-2a10ebeacf47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:16.965097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d28f8966-32bc-40a1-891c-2a10ebeacf47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:16.965674 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d28f8966-32bc-40a1-891c-2a10ebeacf47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:16.966864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d28f8966-32bc-40a1-891c-2a10ebeacf47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:16.967455 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d28f8966-32bc-40a1-891c-2a10ebeacf47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:17.130155 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d28f8966-32bc-40a1-891c-2a10ebeacf47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:17.143413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d28f8966-32bc-40a1-891c-2a10ebeacf47 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.192121 Jun 21 16:00:17.144005 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 337/688] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:16 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:18.167712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-35c5dd08-f77b-4da7-a118-e777e3b14ef9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:18.168424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-35c5dd08-f77b-4da7-a118-e777e3b14ef9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:18.176294 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35c5dd08-f77b-4da7-a118-e777e3b14ef9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:18.176735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35c5dd08-f77b-4da7-a118-e777e3b14ef9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:18.177447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35c5dd08-f77b-4da7-a118-e777e3b14ef9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:18.177955 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35c5dd08-f77b-4da7-a118-e777e3b14ef9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:18.333552 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-35c5dd08-f77b-4da7-a118-e777e3b14ef9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:18.341880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-35c5dd08-f77b-4da7-a118-e777e3b14ef9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.178791 Jun 21 16:00:18.342444 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 352/689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:18 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:19.364038 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-151799e2-64c7-405a-89e6-39d255caf98f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:19.364978 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-151799e2-64c7-405a-89e6-39d255caf98f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:19.375922 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-151799e2-64c7-405a-89e6-39d255caf98f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:19.376657 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-151799e2-64c7-405a-89e6-39d255caf98f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:19.378090 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-151799e2-64c7-405a-89e6-39d255caf98f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:19.378492 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-151799e2-64c7-405a-89e6-39d255caf98f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:19.535462 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-151799e2-64c7-405a-89e6-39d255caf98f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:19.543951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-151799e2-64c7-405a-89e6-39d255caf98f tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.186431 Jun 21 16:00:19.544502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 338/690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:19 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:20.564667 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-07a1f49e-2bd4-4500-806a-50352a216544 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:20.565733 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-07a1f49e-2bd4-4500-806a-50352a216544 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:20.575005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-07a1f49e-2bd4-4500-806a-50352a216544 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:20.575603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-07a1f49e-2bd4-4500-806a-50352a216544 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:20.576624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-07a1f49e-2bd4-4500-806a-50352a216544 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:20.577242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-07a1f49e-2bd4-4500-806a-50352a216544 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:20.692875 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:00:20.693054 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Tue Jun 21 16:00:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 (ip 10.222.0.52) !!! Jun 21 16:00:20.727184 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-07a1f49e-2bd4-4500-806a-50352a216544 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:20.739063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-07a1f49e-2bd4-4500-806a-50352a216544 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.179665 Jun 21 16:00:20.739615 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 353/691] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:20 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:21.757882 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a18ba9d3-1832-4103-8875-68c42c979c3d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:21.758501 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a18ba9d3-1832-4103-8875-68c42c979c3d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:21.766221 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a18ba9d3-1832-4103-8875-68c42c979c3d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:21.766719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a18ba9d3-1832-4103-8875-68c42c979c3d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:21.767567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a18ba9d3-1832-4103-8875-68c42c979c3d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:21.768044 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a18ba9d3-1832-4103-8875-68c42c979c3d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:21.924406 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a18ba9d3-1832-4103-8875-68c42c979c3d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:21.932896 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a18ba9d3-1832-4103-8875-68c42c979c3d tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.179749 Jun 21 16:00:21.933490 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 339/692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:21 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:22.951885 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-87e87c3d-3963-4ddb-bab5-2d17e9512ee9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:22.952500 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-87e87c3d-3963-4ddb-bab5-2d17e9512ee9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:22.960639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87e87c3d-3963-4ddb-bab5-2d17e9512ee9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:22.961074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87e87c3d-3963-4ddb-bab5-2d17e9512ee9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:22.961832 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87e87c3d-3963-4ddb-bab5-2d17e9512ee9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:22.962280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87e87c3d-3963-4ddb-bab5-2d17e9512ee9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:23.120269 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-87e87c3d-3963-4ddb-bab5-2d17e9512ee9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:23.131279 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-87e87c3d-3963-4ddb-bab5-2d17e9512ee9 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.183427 Jun 21 16:00:23.131816 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 354/693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:22 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:24.149076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2d61af70-02fa-4cd0-ab89-80e540326ba2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:24.149649 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2d61af70-02fa-4cd0-ab89-80e540326ba2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:24.156675 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d61af70-02fa-4cd0-ab89-80e540326ba2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:24.157121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d61af70-02fa-4cd0-ab89-80e540326ba2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:24.157942 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d61af70-02fa-4cd0-ab89-80e540326ba2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:24.158361 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2d61af70-02fa-4cd0-ab89-80e540326ba2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:24.313357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2d61af70-02fa-4cd0-ab89-80e540326ba2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:24.324969 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2d61af70-02fa-4cd0-ab89-80e540326ba2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1757 microversion: 2.1 time: 0.180398 Jun 21 16:00:24.325588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 340/694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:24 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:25.346364 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e56aa811-43bf-463b-bc69-4b8bceba30a0 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:25.346966 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e56aa811-43bf-463b-bc69-4b8bceba30a0 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:25.354702 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e56aa811-43bf-463b-bc69-4b8bceba30a0 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:25.355139 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e56aa811-43bf-463b-bc69-4b8bceba30a0 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:25.355889 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e56aa811-43bf-463b-bc69-4b8bceba30a0 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:25.356316 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e56aa811-43bf-463b-bc69-4b8bceba30a0 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:25.518961 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e56aa811-43bf-463b-bc69-4b8bceba30a0 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:25.527634 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e56aa811-43bf-463b-bc69-4b8bceba30a0 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1760 microversion: 2.1 time: 0.187485 Jun 21 16:00:25.528204 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 355/695] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:25 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:27.988384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f519fdda-55ab-4b40-8dac-344d63a85e30 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:27.989440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f519fdda-55ab-4b40-8dac-344d63a85e30 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:27.995881 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f519fdda-55ab-4b40-8dac-344d63a85e30 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:27.996319 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f519fdda-55ab-4b40-8dac-344d63a85e30 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:27.997076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f519fdda-55ab-4b40-8dac-344d63a85e30 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:27.997499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f519fdda-55ab-4b40-8dac-344d63a85e30 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:28.144436 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-f519fdda-55ab-4b40-8dac-344d63a85e30 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lazy-loading 'services' on Instance uuid c6f494bc-2b5c-48f9-9842-5982a0d81192 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:00:28.265927 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f519fdda-55ab-4b40-8dac-344d63a85e30 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/os-volume_attachments/6eb0b042-8356-409a-b867-96e5908a7a10" status: 202 len: 0 microversion: 2.1 time: 0.542675 Jun 21 16:00:28.266940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 341/696] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:00:27 2022] DELETE /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/os-volume_attachments/6eb0b042-8356-409a-b867-96e5908a7a10 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:00:29.393122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-98e254dc-a5ba-46de-b3bd-88fe81613df9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:29.400005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98e254dc-a5ba-46de-b3bd-88fe81613df9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:29.400459 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-98e254dc-a5ba-46de-b3bd-88fe81613df9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:29.460222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-98e254dc-a5ba-46de-b3bd-88fe81613df9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Going to try to stop instance {{(pid=123938) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 16:00:29.506526 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-98e254dc-a5ba-46de-b3bd-88fe81613df9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/action" status: 202 len: 0 microversion: 2.1 time: 0.116931 Jun 21 16:00:29.507130 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 356/697] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 16:00:29 2022] POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:00:29.522886 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f9171b58-3da0-4f39-9bf8-c4bbaa0430d8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:29.524097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f9171b58-3da0-4f39-9bf8-c4bbaa0430d8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:29.536128 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9171b58-3da0-4f39-9bf8-c4bbaa0430d8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:29.536600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9171b58-3da0-4f39-9bf8-c4bbaa0430d8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:29.537329 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9171b58-3da0-4f39-9bf8-c4bbaa0430d8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:29.537734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9171b58-3da0-4f39-9bf8-c4bbaa0430d8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:29.674676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f9171b58-3da0-4f39-9bf8-c4bbaa0430d8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:29.683162 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f9171b58-3da0-4f39-9bf8-c4bbaa0430d8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.169580 Jun 21 16:00:29.683728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 342/698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:29 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:30.702592 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c1ba91ed-3b34-4abf-bfb3-ffe85f3a3c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:30.703372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c1ba91ed-3b34-4abf-bfb3-ffe85f3a3c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:30.712075 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c1ba91ed-3b34-4abf-bfb3-ffe85f3a3c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:30.712572 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c1ba91ed-3b34-4abf-bfb3-ffe85f3a3c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:30.713414 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c1ba91ed-3b34-4abf-bfb3-ffe85f3a3c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:30.713933 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c1ba91ed-3b34-4abf-bfb3-ffe85f3a3c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:30.852986 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c1ba91ed-3b34-4abf-bfb3-ffe85f3a3c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:30.861212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c1ba91ed-3b34-4abf-bfb3-ffe85f3a3c19 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.163924 Jun 21 16:00:30.861803 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 357/699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:30 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:31.273229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:00:31.273719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Tue Jun 21 16:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:00:31.882322 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-57f714a9-fc69-4aa9-8319-d6db15a8cecf tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:31.883176 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-57f714a9-fc69-4aa9-8319-d6db15a8cecf tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:31.892669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57f714a9-fc69-4aa9-8319-d6db15a8cecf tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:31.893320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57f714a9-fc69-4aa9-8319-d6db15a8cecf tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:31.894517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57f714a9-fc69-4aa9-8319-d6db15a8cecf tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:31.895029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57f714a9-fc69-4aa9-8319-d6db15a8cecf tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:32.054244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57f714a9-fc69-4aa9-8319-d6db15a8cecf tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:32.064998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-57f714a9-fc69-4aa9-8319-d6db15a8cecf tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.188296 Jun 21 16:00:32.065798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 343/700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:31 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:33.086142 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4312cd96-8918-47f5-ba9b-266201cf67a2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:33.086917 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4312cd96-8918-47f5-ba9b-266201cf67a2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:33.096908 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4312cd96-8918-47f5-ba9b-266201cf67a2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:33.097610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4312cd96-8918-47f5-ba9b-266201cf67a2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:33.098496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4312cd96-8918-47f5-ba9b-266201cf67a2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:33.099158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4312cd96-8918-47f5-ba9b-266201cf67a2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:33.240516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4312cd96-8918-47f5-ba9b-266201cf67a2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:33.248729 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4312cd96-8918-47f5-ba9b-266201cf67a2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.168773 Jun 21 16:00:33.249307 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 358/701] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:33 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:34.266231 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-efcb5571-7d4a-4587-96c0-c6c63bf15828 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:34.266825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-efcb5571-7d4a-4587-96c0-c6c63bf15828 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:34.274164 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-efcb5571-7d4a-4587-96c0-c6c63bf15828 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:34.274607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-efcb5571-7d4a-4587-96c0-c6c63bf15828 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:34.275370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-efcb5571-7d4a-4587-96c0-c6c63bf15828 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:34.275819 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-efcb5571-7d4a-4587-96c0-c6c63bf15828 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:34.417117 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-efcb5571-7d4a-4587-96c0-c6c63bf15828 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:34.424893 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-efcb5571-7d4a-4587-96c0-c6c63bf15828 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.162550 Jun 21 16:00:34.425497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 344/702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:34 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:35.445280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5ece571a-9e37-4422-81b7-a3dbddb85238 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:35.446160 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5ece571a-9e37-4422-81b7-a3dbddb85238 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:35.454662 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5ece571a-9e37-4422-81b7-a3dbddb85238 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:35.455223 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5ece571a-9e37-4422-81b7-a3dbddb85238 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:35.456208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5ece571a-9e37-4422-81b7-a3dbddb85238 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:35.456799 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5ece571a-9e37-4422-81b7-a3dbddb85238 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:35.602529 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5ece571a-9e37-4422-81b7-a3dbddb85238 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:35.610452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5ece571a-9e37-4422-81b7-a3dbddb85238 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.170318 Jun 21 16:00:35.611024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 359/703] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:35 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:36.306991 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2852040f-fa01-4c77-bc5d-a1bfcbccac2b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74654ae2-74ad-498c-aef1-3cfba1cd2bd7"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:36.308121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2852040f-fa01-4c77-bc5d-a1bfcbccac2b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:36.315134 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2852040f-fa01-4c77-bc5d-a1bfcbccac2b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:36.315568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2852040f-fa01-4c77-bc5d-a1bfcbccac2b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:36.316636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2852040f-fa01-4c77-bc5d-a1bfcbccac2b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:36.317060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2852040f-fa01-4c77-bc5d-a1bfcbccac2b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:36.581933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2852040f-fa01-4c77-bc5d-a1bfcbccac2b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278690 Jun 21 16:00:36.582533 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 345/704] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 16:00:36 2022] POST /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:00:36.629047 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-06c92d77-f447-4a9b-be71-f4b60cdd5aab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:36.629577 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-06c92d77-f447-4a9b-be71-f4b60cdd5aab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:36.635812 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06c92d77-f447-4a9b-be71-f4b60cdd5aab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:36.636262 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06c92d77-f447-4a9b-be71-f4b60cdd5aab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:36.637028 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06c92d77-f447-4a9b-be71-f4b60cdd5aab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:36.637457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06c92d77-f447-4a9b-be71-f4b60cdd5aab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:36.782358 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-06c92d77-f447-4a9b-be71-f4b60cdd5aab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:36.790850 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-06c92d77-f447-4a9b-be71-f4b60cdd5aab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.166804 Jun 21 16:00:36.791522 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 360/705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:36 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:37.809641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f9a625f8-2d42-4ea9-877e-e16eeab7342c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:37.810357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f9a625f8-2d42-4ea9-877e-e16eeab7342c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:37.817499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9a625f8-2d42-4ea9-877e-e16eeab7342c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:37.817961 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9a625f8-2d42-4ea9-877e-e16eeab7342c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:37.818730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9a625f8-2d42-4ea9-877e-e16eeab7342c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:37.819158 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9a625f8-2d42-4ea9-877e-e16eeab7342c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:37.964841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f9a625f8-2d42-4ea9-877e-e16eeab7342c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:37.974844 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f9a625f8-2d42-4ea9-877e-e16eeab7342c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.169937 Jun 21 16:00:37.975418 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 346/706] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:37 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:38.992729 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e05f97e0-518c-410b-8927-096c9dcb9b6e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:38.993305 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e05f97e0-518c-410b-8927-096c9dcb9b6e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:39.000130 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e05f97e0-518c-410b-8927-096c9dcb9b6e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:39.000596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e05f97e0-518c-410b-8927-096c9dcb9b6e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:39.001353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e05f97e0-518c-410b-8927-096c9dcb9b6e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:39.001809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e05f97e0-518c-410b-8927-096c9dcb9b6e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:39.149884 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e05f97e0-518c-410b-8927-096c9dcb9b6e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:39.160843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e05f97e0-518c-410b-8927-096c9dcb9b6e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.171980 Jun 21 16:00:39.161600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 361/707] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:38 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:00:40.183300 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8f8ba786-094b-4540-a03f-6f8b8a2a87f7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:40.183877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8f8ba786-094b-4540-a03f-6f8b8a2a87f7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:40.190953 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8f8ba786-094b-4540-a03f-6f8b8a2a87f7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:40.191422 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8f8ba786-094b-4540-a03f-6f8b8a2a87f7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:40.192171 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8f8ba786-094b-4540-a03f-6f8b8a2a87f7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:40.192595 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8f8ba786-094b-4540-a03f-6f8b8a2a87f7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:40.342416 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8f8ba786-094b-4540-a03f-6f8b8a2a87f7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:40.352208 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8f8ba786-094b-4540-a03f-6f8b8a2a87f7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.173018 Jun 21 16:00:40.352777 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 347/708] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:40 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:41.370732 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-50ed34eb-d16a-49be-a561-8bac56048182 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:41.371341 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-50ed34eb-d16a-49be-a561-8bac56048182 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:41.378248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-50ed34eb-d16a-49be-a561-8bac56048182 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:41.378686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-50ed34eb-d16a-49be-a561-8bac56048182 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:41.380121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-50ed34eb-d16a-49be-a561-8bac56048182 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:41.380610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-50ed34eb-d16a-49be-a561-8bac56048182 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:41.528296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-50ed34eb-d16a-49be-a561-8bac56048182 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:41.541084 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-50ed34eb-d16a-49be-a561-8bac56048182 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.174203 Jun 21 16:00:41.542041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 362/709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:41 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:41.934718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ab3daae2-b673-48a0-b6d3-f6be030a51c6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:41.935215 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ab3daae2-b673-48a0-b6d3-f6be030a51c6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:41.948118 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab3daae2-b673-48a0-b6d3-f6be030a51c6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:41.948560 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab3daae2-b673-48a0-b6d3-f6be030a51c6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:41.949349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab3daae2-b673-48a0-b6d3-f6be030a51c6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:41.949787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab3daae2-b673-48a0-b6d3-f6be030a51c6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:41.966794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:41.974623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ab3daae2-b673-48a0-b6d3-f6be030a51c6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447/ips" status: 200 len: 149 microversion: 2.1 time: 0.164554 Jun 21 16:00:41.975257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 348/710] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 16:00:41 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447/ips => generated 149 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:00:41.987607 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5c8e453-c3a8-48bf-9860-ed699476a7c0"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:41.988733 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:41.996547 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:41.996992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:41.997742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:41.998222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:42.100447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Invalid volume: volume c5c8e453-c3a8-48bf-9860-ed699476a7c0 is already attached to instances: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: POST /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447/os-volume_attachments HTTP/1.1 Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 74 Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:00:42.102735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {"volumeAttachment": {"volumeId": "c5c8e453-c3a8-48bf-9860-ed699476a7c0"}} Jun 21 16:00:42.104396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Invalid volume: volume c5c8e453-c3a8-48bf-9860-ed699476a7c0 is already attached to instances: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'server_id': '8e069614-4aff-4e07-841c-31317d94f447', 'body': {'volumeAttachment': {'volumeId': 'c5c8e453-c3a8-48bf-9860-ed699476a7c0'}}} Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c5c8e453-c3a8-48bf-9860-ed699476a7c0 is already attached to instances: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:42.105617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c5c8e453-c3a8-48bf-9860-ed699476a7c0 is already attached to instances: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:42.107610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:00:42.109494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:00:42.109494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:00:42.109494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:00:42.109494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c5c8e453-c3a8-48bf-9860-ed699476a7c0 is already attached to instances: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 Jun 21 16:00:42.109494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:42.109494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 400 to user: Invalid volume: volume c5c8e453-c3a8-48bf-9860-ed699476a7c0 is already attached to instances: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:00:42.109494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-62f3dbf7-23b8-4bd7-89d6-6361c51f8cc0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120564 Jun 21 16:00:42.109494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 363/711] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 16:00:41 2022] POST /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:00:42.116104 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-52b8e0a5-aef4-48d0-a642-8e7ede0c202d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:42.116605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-52b8e0a5-aef4-48d0-a642-8e7ede0c202d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:42.123663 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52b8e0a5-aef4-48d0-a642-8e7ede0c202d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:42.124125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52b8e0a5-aef4-48d0-a642-8e7ede0c202d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:42.124890 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52b8e0a5-aef4-48d0-a642-8e7ede0c202d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:42.125323 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52b8e0a5-aef4-48d0-a642-8e7ede0c202d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:42.152873 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-52b8e0a5-aef4-48d0-a642-8e7ede0c202d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:00:42.235739 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-52b8e0a5-aef4-48d0-a642-8e7ede0c202d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 204 len: 0 microversion: 2.1 time: 0.124288 Jun 21 16:00:42.236413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 349/712] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:00:42 2022] DELETE /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:00:42.245024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0d1ab41c-a917-4ce9-b62c-e06cfbab8988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:42.245669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0d1ab41c-a917-4ce9-b62c-e06cfbab8988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:42.252834 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0d1ab41c-a917-4ce9-b62c-e06cfbab8988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:42.253288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0d1ab41c-a917-4ce9-b62c-e06cfbab8988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:42.254257 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0d1ab41c-a917-4ce9-b62c-e06cfbab8988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:42.254642 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0d1ab41c-a917-4ce9-b62c-e06cfbab8988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:42.398807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0d1ab41c-a917-4ce9-b62c-e06cfbab8988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:42.406618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0d1ab41c-a917-4ce9-b62c-e06cfbab8988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1679 microversion: 2.1 time: 0.165842 Jun 21 16:00:42.407148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 364/713] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:42 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:42.567114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9cd6b2df-0a22-44dc-becd-8545f4cd316d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:42.567787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9cd6b2df-0a22-44dc-becd-8545f4cd316d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:42.580664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9cd6b2df-0a22-44dc-becd-8545f4cd316d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:42.581116 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9cd6b2df-0a22-44dc-becd-8545f4cd316d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:42.581979 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9cd6b2df-0a22-44dc-becd-8545f4cd316d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:42.582414 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9cd6b2df-0a22-44dc-becd-8545f4cd316d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:42.737866 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9cd6b2df-0a22-44dc-becd-8545f4cd316d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:42.746002 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9cd6b2df-0a22-44dc-becd-8545f4cd316d tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.185347 Jun 21 16:00:42.746575 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 350/714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:42 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:43.424422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-90060eb0-caed-4784-8755-e283e1fbd9df tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:43.425043 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-90060eb0-caed-4784-8755-e283e1fbd9df tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:43.427941 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=31 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:43.433590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-90060eb0-caed-4784-8755-e283e1fbd9df tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:43.434046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-90060eb0-caed-4784-8755-e283e1fbd9df tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:43.434807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-90060eb0-caed-4784-8755-e283e1fbd9df tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:43.435234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-90060eb0-caed-4784-8755-e283e1fbd9df tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:43.438085 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:43.578445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-90060eb0-caed-4784-8755-e283e1fbd9df tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:43.586453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-90060eb0-caed-4784-8755-e283e1fbd9df tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1679 microversion: 2.1 time: 0.165955 Jun 21 16:00:43.587016 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 365/715] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:43 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:43.765001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a1b5246c-f8b4-477b-a032-77fdddefd032 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:43.765596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a1b5246c-f8b4-477b-a032-77fdddefd032 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:43.768033 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:43.773992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a1b5246c-f8b4-477b-a032-77fdddefd032 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:43.774447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a1b5246c-f8b4-477b-a032-77fdddefd032 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:43.775486 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a1b5246c-f8b4-477b-a032-77fdddefd032 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:43.776022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a1b5246c-f8b4-477b-a032-77fdddefd032 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:43.947845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a1b5246c-f8b4-477b-a032-77fdddefd032 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:43.958828 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a1b5246c-f8b4-477b-a032-77fdddefd032 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1677 microversion: 2.1 time: 0.197635 Jun 21 16:00:43.959404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 351/716] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:43 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:44.271248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7c61e057-8038-4046-b3e3-45a71503a2b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:44.271730 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7c61e057-8038-4046-b3e3-45a71503a2b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:44.278589 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c61e057-8038-4046-b3e3-45a71503a2b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:44.279040 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c61e057-8038-4046-b3e3-45a71503a2b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:44.279801 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c61e057-8038-4046-b3e3-45a71503a2b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:44.280229 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c61e057-8038-4046-b3e3-45a71503a2b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:44.310094 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7c61e057-8038-4046-b3e3-45a71503a2b8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments/7b4e314a-a232-44af-824c-a33610fee542" status: 200 len: 194 microversion: 2.20 time: 0.043603 Jun 21 16:00:44.310680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 366/717] 10.222.0.52 () {60 vars in 1453 bytes} [Tue Jun 21 16:00:44 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments/7b4e314a-a232-44af-824c-a33610fee542 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:00:44.380090 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1c51caae-507b-4ec6-a1de-27e15f0413c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:44.380580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1c51caae-507b-4ec6-a1de-27e15f0413c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:44.386931 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c51caae-507b-4ec6-a1de-27e15f0413c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:44.387381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c51caae-507b-4ec6-a1de-27e15f0413c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:44.388136 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c51caae-507b-4ec6-a1de-27e15f0413c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:44.388568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1c51caae-507b-4ec6-a1de-27e15f0413c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:44.494422 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-1c51caae-507b-4ec6-a1de-27e15f0413c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lazy-loading 'services' on Instance uuid 899aef0a-2cf7-47b2-9b08-0068bde58dae {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:00:44.583607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1c51caae-507b-4ec6-a1de-27e15f0413c6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments/7b4e314a-a232-44af-824c-a33610fee542" status: 202 len: 0 microversion: 2.20 time: 0.207640 Jun 21 16:00:44.584206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 352/718] 10.222.0.52 () {60 vars in 1456 bytes} [Tue Jun 21 16:00:44 2022] DELETE /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments/7b4e314a-a232-44af-824c-a33610fee542 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:00:44.594713 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-de9959a2-a705-411f-88bd-5084f30a8270 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:44.595845 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-de9959a2-a705-411f-88bd-5084f30a8270 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:44.604780 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-de9959a2-a705-411f-88bd-5084f30a8270 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:44.605244 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-de9959a2-a705-411f-88bd-5084f30a8270 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:44.605719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-edb3fe93-e173-4f3c-8abc-97e07be78a06 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:44.606019 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-de9959a2-a705-411f-88bd-5084f30a8270 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:44.606443 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-edb3fe93-e173-4f3c-8abc-97e07be78a06 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:44.606582 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-de9959a2-a705-411f-88bd-5084f30a8270 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:44.614886 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edb3fe93-e173-4f3c-8abc-97e07be78a06 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:44.615314 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edb3fe93-e173-4f3c-8abc-97e07be78a06 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:44.616096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edb3fe93-e173-4f3c-8abc-97e07be78a06 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:44.616537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edb3fe93-e173-4f3c-8abc-97e07be78a06 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:44.642131 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-de9959a2-a705-411f-88bd-5084f30a8270 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052565 Jun 21 16:00:44.642727 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 367/719] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jun 21 16:00:44 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:00:44.766378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-edb3fe93-e173-4f3c-8abc-97e07be78a06 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:44.775326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-edb3fe93-e173-4f3c-8abc-97e07be78a06 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1679 microversion: 2.1 time: 0.174362 Jun 21 16:00:44.775903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 353/720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:44 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:44.982395 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ea772f48-6ed3-47da-95fc-f34c25edcf47 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:44.984908 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ea772f48-6ed3-47da-95fc-f34c25edcf47 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:45.000966 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea772f48-6ed3-47da-95fc-f34c25edcf47 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.001798 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea772f48-6ed3-47da-95fc-f34c25edcf47 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.004218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea772f48-6ed3-47da-95fc-f34c25edcf47 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.005274 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea772f48-6ed3-47da-95fc-f34c25edcf47 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.164428 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ea772f48-6ed3-47da-95fc-f34c25edcf47 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:45.172089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ea772f48-6ed3-47da-95fc-f34c25edcf47 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1654 microversion: 2.1 time: 0.195178 Jun 21 16:00:45.172664 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 368/721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:44 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1654 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:00:45.189147 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-edc515ec-ab57-4330-8ff6-5216b8962189 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:45.195466 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edc515ec-ab57-4330-8ff6-5216b8962189 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.195761 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1978df43-7864-4288-914a-e30372e700c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:45.196077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edc515ec-ab57-4330-8ff6-5216b8962189 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.196696 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1978df43-7864-4288-914a-e30372e700c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:45.202745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1978df43-7864-4288-914a-e30372e700c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.203492 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1978df43-7864-4288-914a-e30372e700c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.204238 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1978df43-7864-4288-914a-e30372e700c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.204663 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1978df43-7864-4288-914a-e30372e700c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.230406 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-edc515ec-ab57-4330-8ff6-5216b8962189 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Going to try to start instance {{(pid=123939) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 16:00:45.230676 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-1978df43-7864-4288-914a-e30372e700c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lazy-loading 'flavor' on Instance uuid db5afaf8-702b-44ef-bafd-b80903345966 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:00:45.272350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-edc515ec-ab57-4330-8ff6-5216b8962189 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/action" status: 202 len: 0 microversion: 2.1 time: 0.086920 Jun 21 16:00:45.272960 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 354/722] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 16:00:45 2022] POST /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:00:45.281335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0418d734-a766-45bf-a35d-b41393c77b32 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:45.281976 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0418d734-a766-45bf-a35d-b41393c77b32 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:45.288545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0418d734-a766-45bf-a35d-b41393c77b32 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.289000 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0418d734-a766-45bf-a35d-b41393c77b32 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.289758 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0418d734-a766-45bf-a35d-b41393c77b32 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.290210 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0418d734-a766-45bf-a35d-b41393c77b32 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.357857 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1978df43-7864-4288-914a-e30372e700c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/action" status: 200 len: 32 microversion: 2.1 time: 0.166610 Jun 21 16:00:45.358569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 369/723] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 16:00:45 2022] POST /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 16:00:45.368234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e15db49d-09f1-46ea-812a-02088dda6233 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:45.368949 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e15db49d-09f1-46ea-812a-02088dda6233 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:45.375922 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e15db49d-09f1-46ea-812a-02088dda6233 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.376374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e15db49d-09f1-46ea-812a-02088dda6233 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.377129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e15db49d-09f1-46ea-812a-02088dda6233 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.377561 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e15db49d-09f1-46ea-812a-02088dda6233 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.452644 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0418d734-a766-45bf-a35d-b41393c77b32 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:45.461924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0418d734-a766-45bf-a35d-b41393c77b32 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1663 microversion: 2.1 time: 0.184345 Jun 21 16:00:45.463311 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 355/724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:45 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:45.571047 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e15db49d-09f1-46ea-812a-02088dda6233 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:45.580852 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e15db49d-09f1-46ea-812a-02088dda6233 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.216234 Jun 21 16:00:45.583123 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 370/725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:45 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:00:45.655342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c2ac6e3d-a349-4973-9b7e-4befd77e6229 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:45.656622 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c2ac6e3d-a349-4973-9b7e-4befd77e6229 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:45.665321 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e3d-a349-4973-9b7e-4befd77e6229 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.666156 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e3d-a349-4973-9b7e-4befd77e6229 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.666934 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e3d-a349-4973-9b7e-4befd77e6229 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.667362 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c2ac6e3d-a349-4973-9b7e-4befd77e6229 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.701619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c2ac6e3d-a349-4973-9b7e-4befd77e6229 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050782 Jun 21 16:00:45.703249 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 356/726] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jun 21 16:00:45 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:00:45.792723 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5db78023-c134-46cc-b251-a49e88d200a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:45.793315 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5db78023-c134-46cc-b251-a49e88d200a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:45.800479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5db78023-c134-46cc-b251-a49e88d200a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.801231 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5db78023-c134-46cc-b251-a49e88d200a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:45.802242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5db78023-c134-46cc-b251-a49e88d200a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:45.802824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5db78023-c134-46cc-b251-a49e88d200a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.040921 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5db78023-c134-46cc-b251-a49e88d200a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:46.051433 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5db78023-c134-46cc-b251-a49e88d200a4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1679 microversion: 2.1 time: 0.262333 Jun 21 16:00:46.062553 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 371/727] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:45 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:46.480077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-184cba88-4ddc-4e8e-8f40-5b8b18521b58 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:46.480805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-184cba88-4ddc-4e8e-8f40-5b8b18521b58 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:46.487205 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-184cba88-4ddc-4e8e-8f40-5b8b18521b58 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.487721 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-184cba88-4ddc-4e8e-8f40-5b8b18521b58 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.489189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-184cba88-4ddc-4e8e-8f40-5b8b18521b58 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.489519 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-184cba88-4ddc-4e8e-8f40-5b8b18521b58 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.598227 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-59db2348-cfc6-49c4-8d54-1dc4c7b4e7b2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:46.599429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-59db2348-cfc6-49c4-8d54-1dc4c7b4e7b2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:46.606929 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59db2348-cfc6-49c4-8d54-1dc4c7b4e7b2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.607379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59db2348-cfc6-49c4-8d54-1dc4c7b4e7b2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.608497 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59db2348-cfc6-49c4-8d54-1dc4c7b4e7b2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.608616 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59db2348-cfc6-49c4-8d54-1dc4c7b4e7b2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.630765 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-184cba88-4ddc-4e8e-8f40-5b8b18521b58 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:46.646614 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-184cba88-4ddc-4e8e-8f40-5b8b18521b58 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1663 microversion: 2.1 time: 0.170845 Jun 21 16:00:46.647550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 357/728] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:46 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:00:46.713993 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-492a8cff-a253-4478-85b5-417b3c767db5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:46.715595 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-492a8cff-a253-4478-85b5-417b3c767db5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:46.721912 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-492a8cff-a253-4478-85b5-417b3c767db5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.722510 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-492a8cff-a253-4478-85b5-417b3c767db5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.723669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-492a8cff-a253-4478-85b5-417b3c767db5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.724468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-492a8cff-a253-4478-85b5-417b3c767db5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.752604 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-59db2348-cfc6-49c4-8d54-1dc4c7b4e7b2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:46.756331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-492a8cff-a253-4478-85b5-417b3c767db5 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046921 Jun 21 16:00:46.758046 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 358/729] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jun 21 16:00:46 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:00:46.762404 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-59db2348-cfc6-49c4-8d54-1dc4c7b4e7b2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.168971 Jun 21 16:00:46.763086 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 372/730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:46 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:00:46.826484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-79103540-e441-4f8b-adc7-a104409bcb3f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:46.826983 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-79103540-e441-4f8b-adc7-a104409bcb3f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:46.834492 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-79103540-e441-4f8b-adc7-a104409bcb3f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.834936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-79103540-e441-4f8b-adc7-a104409bcb3f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.835968 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-79103540-e441-4f8b-adc7-a104409bcb3f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.836393 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-79103540-e441-4f8b-adc7-a104409bcb3f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.864826 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-79103540-e441-4f8b-adc7-a104409bcb3f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:00:46.954820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-79103540-e441-4f8b-adc7-a104409bcb3f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 204 len: 0 microversion: 2.20 time: 0.132651 Jun 21 16:00:46.955639 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 359/731] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jun 21 16:00:46 2022] DELETE /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 16:00:46.964030 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:46.964630 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:46.971412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.971864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:46.972947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:46.973385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:47.046248 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-25737462-6f31-407b-a917-870f7cdf0137 req-5f7b5d3d-07b3-4af4-8027-988d58d9d623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e069614-4aff-4e07-841c-31317d94f447", "name": "network-vif-deleted", "tag": "11038423-70d0-440b-b68d-35bfa6a0d923"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:47.058056 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-25737462-6f31-407b-a917-870f7cdf0137 req-5f7b5d3d-07b3-4af4-8027-988d58d9d623 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:47.058815 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-25737462-6f31-407b-a917-870f7cdf0137 req-5f7b5d3d-07b3-4af4-8027-988d58d9d623 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:47.074613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-25737462-6f31-407b-a917-870f7cdf0137 req-5f7b5d3d-07b3-4af4-8027-988d58d9d623 service nova] Creating event network-vif-deleted:11038423-70d0-440b-b68d-35bfa6a0d923 for instance 8e069614-4aff-4e07-841c-31317d94f447 on hv-cinder-84067 Jun 21 16:00:47.080389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-25737462-6f31-407b-a917-870f7cdf0137 req-5f7b5d3d-07b3-4af4-8027-988d58d9d623 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039929 Jun 21 16:00:47.084387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 360/732] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:00:47.090151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7b8c42d1-5d66-4d51-acb7-951ab6edd09b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:47.091015 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7b8c42d1-5d66-4d51-acb7-951ab6edd09b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:47.098178 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7b8c42d1-5d66-4d51-acb7-951ab6edd09b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:47.098768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7b8c42d1-5d66-4d51-acb7-951ab6edd09b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:47.099559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7b8c42d1-5d66-4d51-acb7-951ab6edd09b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:47.100051 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7b8c42d1-5d66-4d51-acb7-951ab6edd09b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:47.104787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:47.144074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:47.152896 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:47.154721 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:47.156083 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ab639ff3-8152-4c5d-9f81-a7dcddaca757 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.196060 Jun 21 16:00:47.156960 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 373/733] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:46 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:47.184410 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7b8c42d1-5d66-4d51-acb7-951ab6edd09b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:47.192401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7b8c42d1-5d66-4d51-acb7-951ab6edd09b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1612 microversion: 2.1 time: 0.106735 Jun 21 16:00:47.192962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 361/734] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:47 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:47.664919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-40d4deba-9ee0-4451-8724-29ed75ffe0cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:47.665609 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-40d4deba-9ee0-4451-8724-29ed75ffe0cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:47.672243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-40d4deba-9ee0-4451-8724-29ed75ffe0cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:47.672770 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-40d4deba-9ee0-4451-8724-29ed75ffe0cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:47.673610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-40d4deba-9ee0-4451-8724-29ed75ffe0cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:47.674150 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-40d4deba-9ee0-4451-8724-29ed75ffe0cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:47.783639 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3cf30917-49cb-47ba-b6d0-3413f02aa8c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:47.785757 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3cf30917-49cb-47ba-b6d0-3413f02aa8c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:47.794551 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3cf30917-49cb-47ba-b6d0-3413f02aa8c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:47.796123 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3cf30917-49cb-47ba-b6d0-3413f02aa8c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:47.797026 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3cf30917-49cb-47ba-b6d0-3413f02aa8c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:47.797716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3cf30917-49cb-47ba-b6d0-3413f02aa8c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:47.815133 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-40d4deba-9ee0-4451-8724-29ed75ffe0cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:47.825348 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-40d4deba-9ee0-4451-8724-29ed75ffe0cc tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1663 microversion: 2.1 time: 0.164658 Jun 21 16:00:47.826890 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 374/735] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:47 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:00:47.937807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3cf30917-49cb-47ba-b6d0-3413f02aa8c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:47.946725 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3cf30917-49cb-47ba-b6d0-3413f02aa8c8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.169616 Jun 21 16:00:47.947308 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 362/736] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:47 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:48.174768 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:48.175484 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:48.183628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:48.183628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:48.184232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:48.184651 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:48.211409 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0f18100c-39bc-4ec3-aac2-92d6ef360efe tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:48.212012 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0f18100c-39bc-4ec3-aac2-92d6ef360efe tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:48.218299 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0f18100c-39bc-4ec3-aac2-92d6ef360efe tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:48.218737 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0f18100c-39bc-4ec3-aac2-92d6ef360efe tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:48.219533 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0f18100c-39bc-4ec3-aac2-92d6ef360efe tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:48.219915 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0f18100c-39bc-4ec3-aac2-92d6ef360efe tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:48.332832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0f18100c-39bc-4ec3-aac2-92d6ef360efe tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:48.340916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0f18100c-39bc-4ec3-aac2-92d6ef360efe tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1612 microversion: 2.1 time: 0.133724 Jun 21 16:00:48.341834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 363/737] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:48 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1612 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:48.363101 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:48.376149 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:48.378879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:48.383257 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c35060e2-53c7-40ce-87b3-e0dc95e49589 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.211819 Jun 21 16:00:48.384076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 375/738] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:48 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:48.843640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-57c7d369-94ea-4bc9-9eb5-1eed39025c79 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:48.844244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-57c7d369-94ea-4bc9-9eb5-1eed39025c79 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:48.852312 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57c7d369-94ea-4bc9-9eb5-1eed39025c79 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:48.852807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57c7d369-94ea-4bc9-9eb5-1eed39025c79 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:48.853522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57c7d369-94ea-4bc9-9eb5-1eed39025c79 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:48.854004 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57c7d369-94ea-4bc9-9eb5-1eed39025c79 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:48.964813 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-34ec651c-74f1-458e-a4ee-3ba4225b711e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:48.965462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-34ec651c-74f1-458e-a4ee-3ba4225b711e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:48.972006 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-34ec651c-74f1-458e-a4ee-3ba4225b711e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:48.972553 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-34ec651c-74f1-458e-a4ee-3ba4225b711e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:48.974049 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-34ec651c-74f1-458e-a4ee-3ba4225b711e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:48.974049 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-34ec651c-74f1-458e-a4ee-3ba4225b711e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:49.000460 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57c7d369-94ea-4bc9-9eb5-1eed39025c79 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:49.013238 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-57c7d369-94ea-4bc9-9eb5-1eed39025c79 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1667 microversion: 2.1 time: 0.173163 Jun 21 16:00:49.025436 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 364/739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:48 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1667 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:49.133910 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-34ec651c-74f1-458e-a4ee-3ba4225b711e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:49.142183 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-34ec651c-74f1-458e-a4ee-3ba4225b711e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.181400 Jun 21 16:00:49.142771 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 376/740] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:48 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:49.359121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:49.359724 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:49.366910 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:49.367385 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:49.368146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:49.368572 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:49.401012 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:49.401356 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:49.401805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'fault' on Instance uuid 8e069614-4aff-4e07-841c-31317d94f447 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:00:49.402128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:49.402731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:49.409275 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:49.409760 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:49.410780 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:49.411208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:49.443590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:49.451250 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7cf18eab-9233-4fee-920f-d69f2e0b89bc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 200 len: 1330 microversion: 2.1 time: 0.096102 Jun 21 16:00:49.451774 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 365/741] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:49 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:49.553715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:49.562416 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:49.563905 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:49.565076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e274c9ab-8a95-421f-be4e-d57e8144f16c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1723 microversion: 2.20 time: 0.167019 Jun 21 16:00:49.565879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 377/742] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:49 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:50.162346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-eebd7517-b522-4e8f-b6f1-593dabe569d8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:50.163155 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-eebd7517-b522-4e8f-b6f1-593dabe569d8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:50.170079 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eebd7517-b522-4e8f-b6f1-593dabe569d8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:50.170763 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eebd7517-b522-4e8f-b6f1-593dabe569d8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:50.171517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eebd7517-b522-4e8f-b6f1-593dabe569d8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:50.171937 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eebd7517-b522-4e8f-b6f1-593dabe569d8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:50.310056 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-eebd7517-b522-4e8f-b6f1-593dabe569d8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:50.319468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-eebd7517-b522-4e8f-b6f1-593dabe569d8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.162175 Jun 21 16:00:50.320043 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 366/743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:50 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:50.466457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-7db58744-9ee2-4c10-8770-333b597bc52c req-c717d343-7a93-4f3a-87d0-474cf69099ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899aef0a-2cf7-47b2-9b08-0068bde58dae", "name": "network-vif-deleted", "tag": "6288bac4-2f2c-42ad-9eca-74ece6209900"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:50.468964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:50.469560 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:50.477592 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:50.477900 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-7db58744-9ee2-4c10-8770-333b597bc52c req-c717d343-7a93-4f3a-87d0-474cf69099ae service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:50.478311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-7db58744-9ee2-4c10-8770-333b597bc52c req-c717d343-7a93-4f3a-87d0-474cf69099ae service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:50.478820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:50.479754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:50.480333 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:50.492410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-7db58744-9ee2-4c10-8770-333b597bc52c req-c717d343-7a93-4f3a-87d0-474cf69099ae service nova] Creating event network-vif-deleted:6288bac4-2f2c-42ad-9eca-74ece6209900 for instance 899aef0a-2cf7-47b2-9b08-0068bde58dae on hv-cinder-84067 Jun 21 16:00:50.496169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 HTTP/1.1 Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:00:50.497877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:00:50.499618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '8e069614-4aff-4e07-841c-31317d94f447'} Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:00:50.500537 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:00:50.501794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:00:50.503359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:00:50.503513 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-7db58744-9ee2-4c10-8770-333b597bc52c req-c717d343-7a93-4f3a-87d0-474cf69099ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037130 Jun 21 16:00:50.503513 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 378/744] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:00:50.504236 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-040e5aba-c52a-4894-840c-fb979080a673 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 404 len: 111 microversion: 2.1 time: 0.039347 Jun 21 16:00:50.508420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 367/745] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:50 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:00:50.522215 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d748df82-96ff-427b-b40d-409ee5e4a85a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '.version_select at 0x7f73b5cf8040>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:50.554390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d748df82-96ff-427b-b40d-409ee5e4a85a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-336204172" status: 202 len: 0 microversion: 2.1 time: 0.039212 Jun 21 16:00:50.554969 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 379/746] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Jun 21 16:00:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-336204172 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 16:00:50.591489 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:50.592100 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:50.605141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:50.606059 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:50.606982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:50.608036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:50.653356 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:50.653816 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:50.654292 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lazy-loading 'fault' on Instance uuid 899aef0a-2cf7-47b2-9b08-0068bde58dae {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:00:50.718129 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:50.731114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:50.734152 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:50.737169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c0d297cd-d5c0-48e8-a4ba-906a819e24f8 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 200 len: 1371 microversion: 2.20 time: 0.156820 Jun 21 16:00:50.739962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 368/747] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:50 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:51.336814 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2751b95c-b090-4cc5-b2b2-663262a6e6e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:51.337540 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2751b95c-b090-4cc5-b2b2-663262a6e6e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:51.345628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2751b95c-b090-4cc5-b2b2-663262a6e6e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:51.346773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2751b95c-b090-4cc5-b2b2-663262a6e6e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:51.348477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2751b95c-b090-4cc5-b2b2-663262a6e6e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:51.348977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2751b95c-b090-4cc5-b2b2-663262a6e6e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:51.583344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2751b95c-b090-4cc5-b2b2-663262a6e6e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:51.593661 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2751b95c-b090-4cc5-b2b2-663262a6e6e9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.260812 Jun 21 16:00:51.594545 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 380/748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:51 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:51.688983 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4b6b88fe-397a-4e10-8d89-6848714cc441 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:51.689552 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4b6b88fe-397a-4e10-8d89-6848714cc441 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:51.697229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4b6b88fe-397a-4e10-8d89-6848714cc441 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:51.697667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4b6b88fe-397a-4e10-8d89-6848714cc441 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:51.698443 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4b6b88fe-397a-4e10-8d89-6848714cc441 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:51.698859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4b6b88fe-397a-4e10-8d89-6848714cc441 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:51.759962 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:51.761196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:51.769210 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:51.769876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:51.771138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:51.772813 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:51.786651 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-4b6b88fe-397a-4e10-8d89-6848714cc441 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'services' on Instance uuid 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:00:51.791040 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] HTTP exception thrown: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Request method failure captured: Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae HTTP/1.1 Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemOBnizETzZO5s2RmHKmbdXQpcyAhNyvmOWYGE4F95pvQplUfOu-0Wqlc-mPqPNtY9VaHHU0VnqJ_0aB7G5aZkoIhJ4Nlt9vm52QcaDtj1Ipk5T65T4L6N950xXzSsOfD6BwAQUa6hHLvlE0IA0EvLxFgMSYFN2TxCofd_uslOEMcE Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:00:51.792879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f3f5c4b63c45d691e2b66883eda54a", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 75407a21b1fd46e8ba10540fc5a4c30a Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:00:51.794742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '899aef0a-2cf7-47b2-9b08-0068bde58dae'} Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:00:51.795824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:00:51.797097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:51.798354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Returning 404 to user: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:00:51.798354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dd336f1b-6465-4d8c-a37e-05bc2efa443a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 404 len: 111 microversion: 2.20 time: 0.038513 Jun 21 16:00:51.798354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 381/749] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:51 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:00:51.803879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d6655610-4e49-4cc2-a4d2-0e0cace9c1d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '.version_select at 0x7f73b5c78280>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:51.828148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d6655610-4e49-4cc2-a4d2-0e0cace9c1d9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632838168" status: 204 len: 0 microversion: 2.20 time: 0.027650 Jun 21 16:00:51.828728 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 382/750] 10.222.0.52 () {60 vars in 1261 bytes} [Tue Jun 21 16:00:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632838168 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 16:00:51.874326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4b6b88fe-397a-4e10-8d89-6848714cc441 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-volume_attachments/c5c8e453-c3a8-48bf-9860-ed699476a7c0" status: 202 len: 0 microversion: 2.1 time: 0.189159 Jun 21 16:00:51.874918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 369/751] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:00:51 2022] DELETE /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-volume_attachments/c5c8e453-c3a8-48bf-9860-ed699476a7c0 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:00:51.884273 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b492a0f4-2305-4135-8e49-84da6c154e72 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:51.885532 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b492a0f4-2305-4135-8e49-84da6c154e72 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:51.898516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b492a0f4-2305-4135-8e49-84da6c154e72 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:51.899254 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b492a0f4-2305-4135-8e49-84da6c154e72 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:51.900194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b492a0f4-2305-4135-8e49-84da6c154e72 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:51.906360 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b492a0f4-2305-4135-8e49-84da6c154e72 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:51.932767 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:51.949457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b492a0f4-2305-4135-8e49-84da6c154e72 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069526 Jun 21 16:00:51.950506 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 383/752] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:00:51 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:00:52.579235 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fb119795-2627-4a52-ab57-b04f0f5e4b1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'create', calling method: .version_select at 0x7f73b5f911f0>, body: {"keypair": {"name": "tempest-keypair-1328571372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPmGM9X/vQP+6Jo0wr0GeRd3mZ8AwhG4degWynj+kxQAwwuKB4kj/AgqsCNjh8NO7PaD6ivm65Skp0QSwidtiA8aTKb0IChdFzTJu5OgV4gaw+v1cJMn4pIy4d2IO9S+Q=="}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:52.594461 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-fb119795-2627-4a52-ab57-b04f0f5e4b1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Getting quotas for project 74f3f5c4b63c45d691e2b66883eda54a. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:00:52.598971 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-fb119795-2627-4a52-ab57-b04f0f5e4b1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Getting quotas for user 75407a21b1fd46e8ba10540fc5a4c30a and project 74f3f5c4b63c45d691e2b66883eda54a. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:00:52.612125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ef9d24cf-913d-4ae3-878e-c2bbeb5edccd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:52.613169 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ef9d24cf-913d-4ae3-878e-c2bbeb5edccd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:52.620097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ef9d24cf-913d-4ae3-878e-c2bbeb5edccd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:52.620668 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ef9d24cf-913d-4ae3-878e-c2bbeb5edccd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:52.621439 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ef9d24cf-913d-4ae3-878e-c2bbeb5edccd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:52.621909 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ef9d24cf-913d-4ae3-878e-c2bbeb5edccd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:52.626791 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fb119795-2627-4a52-ab57-b04f0f5e4b1b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052133 Jun 21 16:00:52.627588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 370/753] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Jun 21 16:00:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 16:00:52.821840 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ef9d24cf-913d-4ae3-878e-c2bbeb5edccd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:52.830905 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ef9d24cf-913d-4ae3-878e-c2bbeb5edccd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.223150 Jun 21 16:00:52.831593 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 384/754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:52 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:52.962423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bb8ea8b2-603f-4ba8-b9d0-de9af136fb66 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:52.963712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bb8ea8b2-603f-4ba8-b9d0-de9af136fb66 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:52.970393 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bb8ea8b2-603f-4ba8-b9d0-de9af136fb66 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:52.970915 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bb8ea8b2-603f-4ba8-b9d0-de9af136fb66 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:52.971938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bb8ea8b2-603f-4ba8-b9d0-de9af136fb66 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:52.973014 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bb8ea8b2-603f-4ba8-b9d0-de9af136fb66 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:53.014948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bb8ea8b2-603f-4ba8-b9d0-de9af136fb66 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057243 Jun 21 16:00:53.015516 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 371/755] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:00:52 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:00:53.077111 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-742079d6-62ac-4210-8d52-f74ac356730a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:53.078237 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-742079d6-62ac-4210-8d52-f74ac356730a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:53.084972 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-742079d6-62ac-4210-8d52-f74ac356730a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:53.085509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-742079d6-62ac-4210-8d52-f74ac356730a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:53.086374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-742079d6-62ac-4210-8d52-f74ac356730a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:53.086867 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-742079d6-62ac-4210-8d52-f74ac356730a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:53.119073 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-742079d6-62ac-4210-8d52-f74ac356730a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:00:53.215482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-742079d6-62ac-4210-8d52-f74ac356730a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 204 len: 0 microversion: 2.1 time: 0.142086 Jun 21 16:00:53.216468 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 385/756] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:00:53 2022] DELETE /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:00:53.227847 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a9d4d226-e6e3-492c-939f-8ed365d419dc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:53.228863 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a9d4d226-e6e3-492c-939f-8ed365d419dc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:53.239132 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a9d4d226-e6e3-492c-939f-8ed365d419dc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:53.239579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a9d4d226-e6e3-492c-939f-8ed365d419dc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:53.240353 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a9d4d226-e6e3-492c-939f-8ed365d419dc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:53.241004 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a9d4d226-e6e3-492c-939f-8ed365d419dc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:53.387471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a9d4d226-e6e3-492c-939f-8ed365d419dc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:53.396833 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a9d4d226-e6e3-492c-939f-8ed365d419dc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1681 microversion: 2.1 time: 0.175021 Jun 21 16:00:53.397450 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 372/757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:53 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:53.850295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0904364a-5b50-4f33-9166-7556f572a1ec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:53.851126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0904364a-5b50-4f33-9166-7556f572a1ec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:53.857999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0904364a-5b50-4f33-9166-7556f572a1ec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:53.858540 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0904364a-5b50-4f33-9166-7556f572a1ec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:53.859389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0904364a-5b50-4f33-9166-7556f572a1ec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:53.859896 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0904364a-5b50-4f33-9166-7556f572a1ec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:54.014988 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0904364a-5b50-4f33-9166-7556f572a1ec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:54.024791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0904364a-5b50-4f33-9166-7556f572a1ec tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.179738 Jun 21 16:00:54.025379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 386/758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:53 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:54.099533 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-678242380", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a2a2c79-171c-46ca-b6cc-a6b3bdd3c9a4"}], "security_groups": [{"name": "tempest-securitygroup--424325474"}], "key_name": "tempest-keypair-1328571372", "user_data": "}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:54.216469 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] validate_networks() for [('7a2a2c79-171c-46ca-b6cc-a6b3bdd3c9a4', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:00:54.414680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-29da1208-8e4e-45af-bd7d-2f7e4a6462cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:54.415282 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-29da1208-8e4e-45af-bd7d-2f7e4a6462cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:54.423194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-29da1208-8e4e-45af-bd7d-2f7e4a6462cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:54.423609 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-29da1208-8e4e-45af-bd7d-2f7e4a6462cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:54.424414 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-29da1208-8e4e-45af-bd7d-2f7e4a6462cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:54.424898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-29da1208-8e4e-45af-bd7d-2f7e4a6462cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:54.581224 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-29da1208-8e4e-45af-bd7d-2f7e4a6462cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:54.589702 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-29da1208-8e4e-45af-bd7d-2f7e4a6462cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1681 microversion: 2.1 time: 0.178748 Jun 21 16:00:54.590477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 387/759] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:54 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:00:54.747708 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:00:54.748121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:00:54.748581 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:00:54.748979 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:00:54.749372 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:00:54.759236 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:54.759671 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:54.760545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:54.760910 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:54.779557 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Getting quotas for project 74f3f5c4b63c45d691e2b66883eda54a. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:00:54.784425 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Getting quotas for user 75407a21b1fd46e8ba10540fc5a4c30a and project 74f3f5c4b63c45d691e2b66883eda54a. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:00:54.798813 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:00:54.801797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:00:54.857673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-47e4b1dd-da13-44e5-bd33-397d72a13f08 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.763447 Jun 21 16:00:54.858696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 373/760] 10.222.0.52 () {62 vars in 1187 bytes} [Tue Jun 21 16:00:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 16:00:54.869925 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0045ea89-a47c-48cd-a430-c37518609a91 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:54.870576 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0045ea89-a47c-48cd-a430-c37518609a91 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:54.933094 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0045ea89-a47c-48cd-a430-c37518609a91 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:54.941238 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0045ea89-a47c-48cd-a430-c37518609a91 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:54.943135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0045ea89-a47c-48cd-a430-c37518609a91 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:54.944266 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0045ea89-a47c-48cd-a430-c37518609a91 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1281 microversion: 2.20 time: 0.078598 Jun 21 16:00:54.955427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 388/761] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:54 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:55.043658 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-596156c1-c075-46df-9a37-dd7b7200a0ae tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:55.044290 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-596156c1-c075-46df-9a37-dd7b7200a0ae tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:55.054760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-596156c1-c075-46df-9a37-dd7b7200a0ae tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:55.055243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-596156c1-c075-46df-9a37-dd7b7200a0ae tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:55.056031 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-596156c1-c075-46df-9a37-dd7b7200a0ae tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:55.056954 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-596156c1-c075-46df-9a37-dd7b7200a0ae tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:55.252025 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-596156c1-c075-46df-9a37-dd7b7200a0ae tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:55.262874 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-596156c1-c075-46df-9a37-dd7b7200a0ae tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.223223 Jun 21 16:00:55.264089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 374/762] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:55 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:55.420732 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-f3987038-08b6-4155-9a67-899788667a54 req-2cbbd44b-263f-4094-8802-151ab26a29b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd1f66a-f226-49c0-8f07-54b3c9abc2c2", "name": "network-vif-deleted", "tag": "e91ce2c0-3142-4f10-9149-df9295df6dc5"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:55.431141 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-f3987038-08b6-4155-9a67-899788667a54 req-2cbbd44b-263f-4094-8802-151ab26a29b8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:55.431590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-f3987038-08b6-4155-9a67-899788667a54 req-2cbbd44b-263f-4094-8802-151ab26a29b8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:55.443062 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-f3987038-08b6-4155-9a67-899788667a54 req-2cbbd44b-263f-4094-8802-151ab26a29b8 service nova] Creating event network-vif-deleted:e91ce2c0-3142-4f10-9149-df9295df6dc5 for instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 on hv-cinder-84067 Jun 21 16:00:55.448502 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-f3987038-08b6-4155-9a67-899788667a54 req-2cbbd44b-263f-4094-8802-151ab26a29b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031789 Jun 21 16:00:55.449115 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 389/763] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:00:55.607798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:55.608418 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:55.631719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:55.632152 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:55.632948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:55.633373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:55.678779 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:55.679204 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:55.679655 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'fault' on Instance uuid 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:00:55.739036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:55.748150 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e0c0aa6f-576b-4138-b72e-a30753bffb02 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 200 len: 1331 microversion: 2.1 time: 0.144349 Jun 21 16:00:55.748737 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 375/764] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:55 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:55.964531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:55.965214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:55.971948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:55.972445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:55.973221 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:55.973682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:56.037521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:56.046015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:56.047542 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:56.048722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ae29297e-f3aa-4165-93c9-51ab5b67760a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1333 microversion: 2.20 time: 0.089130 Jun 21 16:00:56.049487 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 390/765] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:55 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:56.280436 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-61a80102-813e-4542-83e2-e1829e7bdfc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:56.282001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-61a80102-813e-4542-83e2-e1829e7bdfc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:56.288967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-61a80102-813e-4542-83e2-e1829e7bdfc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:56.289705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-61a80102-813e-4542-83e2-e1829e7bdfc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:56.290745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-61a80102-813e-4542-83e2-e1829e7bdfc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:56.291345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-61a80102-813e-4542-83e2-e1829e7bdfc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:56.470564 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-61a80102-813e-4542-83e2-e1829e7bdfc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:56.479016 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-61a80102-813e-4542-83e2-e1829e7bdfc7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.202375 Jun 21 16:00:56.479602 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 376/766] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:56 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:56.765340 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:56.765974 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:56.773096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:56.773531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:56.774328 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:56.774746 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:56.791796 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 HTTP/1.1 Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:00:56.793450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:00:56.795059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '0dd1f66a-f226-49c0-8f07-54b3c9abc2c2'} Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:00:56.795838 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:00:56.796946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:00:56.797997 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:00:56.797997 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d7dc622d-334b-4a76-84ce-68725ca32a82 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 404 len: 111 microversion: 2.1 time: 0.033737 Jun 21 16:00:56.797997 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 391/767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:56 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:00:56.806108 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f863c4ce-6891-4a74-b90a-7a7917ec8b8d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '.version_select at 0x7f73b5f91940>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:56.828092 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f863c4ce-6891-4a74-b90a-7a7917ec8b8d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149309982" status: 202 len: 0 microversion: 2.1 time: 0.027002 Jun 21 16:00:56.832186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 377/768] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Jun 21 16:00:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149309982 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:00:57.067184 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:57.067767 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:57.074702 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:57.075392 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:57.076311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:57.077200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:57.344114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:57.353709 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:57.355237 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:57.356341 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c64d5049-430f-4b46-9821-c4acb228f915 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.293186 Jun 21 16:00:57.356915 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 392/769] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:57 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:57.597294 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d44571e6-21f7-4aef-b6f7-b6b520c4f5e9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: .version_select at 0x7f73b5c788b0>, body: {"keypair": {"name": "tempest-keypair-866948492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCQbZWpORmzj1I3s1hhJ/Ww/ulhPQWv0XYNlKZM5Xk71S/DS516AT8B+IG+XMO5ITndt36uRGx60GPLphBglXrV01nfO0Bh5Bdr+MBFfKkRse1xFlYB7iKoCzjneUWp6A=="}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:57.613033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-d44571e6-21f7-4aef-b6f7-b6b520c4f5e9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for project d20d29454c00499282eb86547eeb4c10. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:00:57.617066 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fcecfbcf-71f5-4bf6-b26b-50824a620995 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:57.617947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-d44571e6-21f7-4aef-b6f7-b6b520c4f5e9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for user 9a67a5c4b7034d22b78331b907cc20bc and project d20d29454c00499282eb86547eeb4c10. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:00:57.618921 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fcecfbcf-71f5-4bf6-b26b-50824a620995 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:57.625038 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fcecfbcf-71f5-4bf6-b26b-50824a620995 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:57.625476 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fcecfbcf-71f5-4bf6-b26b-50824a620995 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:57.626299 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fcecfbcf-71f5-4bf6-b26b-50824a620995 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:57.626723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fcecfbcf-71f5-4bf6-b26b-50824a620995 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:57.640423 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d44571e6-21f7-4aef-b6f7-b6b520c4f5e9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047087 Jun 21 16:00:57.641123 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 393/770] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 16:00:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:00:57.769252 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fcecfbcf-71f5-4bf6-b26b-50824a620995 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:57.777355 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fcecfbcf-71f5-4bf6-b26b-50824a620995 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.284428 Jun 21 16:00:57.778349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 378/771] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:57 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:58.376215 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:58.376807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:58.384354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:58.385064 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:58.386268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:58.387077 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:58.594567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:58.606308 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:58.608376 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:58.609916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-81e54021-9229-4417-930f-84e323bed708 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.238204 Jun 21 16:00:58.620999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 394/772] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:58 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:58.795402 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-07ed4e28-8654-4879-9f37-a0413c8dc4f4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:58.802198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-07ed4e28-8654-4879-9f37-a0413c8dc4f4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:58.809132 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-07ed4e28-8654-4879-9f37-a0413c8dc4f4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:58.809574 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-07ed4e28-8654-4879-9f37-a0413c8dc4f4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:58.810634 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-07ed4e28-8654-4879-9f37-a0413c8dc4f4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:58.810824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-07ed4e28-8654-4879-9f37-a0413c8dc4f4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:58.840288 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:58.983325 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-14f9b3d8-2f0d-4ac4-91f2-1e7e191cd870 req-3ae6c659-4131-4d6f-8f48-d9ed16e72e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cea78e9-1d9b-4b08-bbe5-93fadd09e685", "tag": "b76d21d6-4f2c-4f99-a9ef-d06b45b48736"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:58.996936 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-14f9b3d8-2f0d-4ac4-91f2-1e7e191cd870 req-3ae6c659-4131-4d6f-8f48-d9ed16e72e76 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:58.997366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-14f9b3d8-2f0d-4ac4-91f2-1e7e191cd870 req-3ae6c659-4131-4d6f-8f48-d9ed16e72e76 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:59.026233 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-14f9b3d8-2f0d-4ac4-91f2-1e7e191cd870 req-3ae6c659-4131-4d6f-8f48-d9ed16e72e76 service nova] Creating event network-changed:b76d21d6-4f2c-4f99-a9ef-d06b45b48736 for instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 on hv-cinder-84067 Jun 21 16:00:59.031490 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-14f9b3d8-2f0d-4ac4-91f2-1e7e191cd870 req-3ae6c659-4131-4d6f-8f48-d9ed16e72e76 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053630 Jun 21 16:00:59.032097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 395/773] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:00:59.092937 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-07ed4e28-8654-4879-9f37-a0413c8dc4f4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:59.120628 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-07ed4e28-8654-4879-9f37-a0413c8dc4f4 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.329308 Jun 21 16:00:59.121146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 379/774] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:58 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:00:59.194420 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1701059148", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cdeeb75-9f47-4354-8a71-6e4a191914df"}], "security_groups": [{"name": "tempest-securitygroup--315837731"}], "key_name": "tempest-keypair-866948492", "user_data": "}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:00:59.299138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] validate_networks() for [('5cdeeb75-9f47-4354-8a71-6e4a191914df', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:00:59.629363 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:59.629960 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:59.636756 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:59.637195 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:59.638003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:59.638428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:59.766717 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:00:59.767837 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:00:59.768618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:00:59.769899 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:00:59.770128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:00:59.780313 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:59.781449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:59.782387 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:00:59.782990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:00:59.804686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for project d20d29454c00499282eb86547eeb4c10. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:00:59.810195 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for user 9a67a5c4b7034d22b78331b907cc20bc and project d20d29454c00499282eb86547eeb4c10. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:00:59.817170 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:59.823296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:00:59.825711 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:00:59.842198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:59.844065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:59.845342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b05fb7bc-1f1c-4a8e-be30-8752f81913f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.220927 Jun 21 16:00:59.846130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 380/775] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:00:59 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:00:59.850057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:59.879272 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-45920ca9-9b1e-48fd-82a0-b118e5693ff0 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.690031 Jun 21 16:00:59.879926 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 396/776] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:00:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:00:59.890046 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c21d4cbb-05fa-4d6d-9f3a-4c420fbcdeda tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:00:59.890791 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c21d4cbb-05fa-4d6d-9f3a-4c420fbcdeda tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:00:59.892797 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:59.949323 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c21d4cbb-05fa-4d6d-9f3a-4c420fbcdeda tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:00:59.959369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c21d4cbb-05fa-4d6d-9f3a-4c420fbcdeda tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1241 microversion: 2.1 time: 0.073211 Jun 21 16:00:59.959941 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 381/777] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:00:59 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:00.138445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-44201abc-2b75-4b51-8d58-2bee247d2734 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:00.139214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-44201abc-2b75-4b51-8d58-2bee247d2734 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:00.148955 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-44201abc-2b75-4b51-8d58-2bee247d2734 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:00.149497 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-44201abc-2b75-4b51-8d58-2bee247d2734 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:00.150373 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-44201abc-2b75-4b51-8d58-2bee247d2734 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:00.150957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-44201abc-2b75-4b51-8d58-2bee247d2734 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:00.300306 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-44201abc-2b75-4b51-8d58-2bee247d2734 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:00.311270 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-44201abc-2b75-4b51-8d58-2bee247d2734 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1736 microversion: 2.1 time: 0.177296 Jun 21 16:01:00.311889 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 397/778] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:00 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:00.866475 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:00.867184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:00.878089 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:00.878635 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:00.879381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:00.879814 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:00.977268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0c19a9f1-0b40-4134-beb3-42b3cd6de6b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:00.977845 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0c19a9f1-0b40-4134-beb3-42b3cd6de6b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:00.984726 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0c19a9f1-0b40-4134-beb3-42b3cd6de6b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:00.985161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0c19a9f1-0b40-4134-beb3-42b3cd6de6b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:00.985952 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0c19a9f1-0b40-4134-beb3-42b3cd6de6b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:00.986379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0c19a9f1-0b40-4134-beb3-42b3cd6de6b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.018876 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:01.027210 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:01.028698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:01.029883 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5fde4245-c1d8-4335-9d4b-8d630f57e647 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.168687 Jun 21 16:01:01.030397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 382/779] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:01:00 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:01:01.053349 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0c19a9f1-0b40-4134-beb3-42b3cd6de6b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:01.061044 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0c19a9f1-0b40-4134-beb3-42b3cd6de6b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1245 microversion: 2.1 time: 0.087663 Jun 21 16:01:01.061609 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 398/780] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:00 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:01.331391 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1127e2d3-6600-4519-b70f-736eef1384e1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:01.331999 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1127e2d3-6600-4519-b70f-736eef1384e1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:01.338478 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1127e2d3-6600-4519-b70f-736eef1384e1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:01.338893 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1127e2d3-6600-4519-b70f-736eef1384e1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.339683 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1127e2d3-6600-4519-b70f-736eef1384e1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:01.340115 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1127e2d3-6600-4519-b70f-736eef1384e1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.480720 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1127e2d3-6600-4519-b70f-736eef1384e1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:01.489486 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1127e2d3-6600-4519-b70f-736eef1384e1 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1716 microversion: 2.1 time: 0.163430 Jun 21 16:01:01.490078 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 383/781] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:01 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:01.546646 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:01.547161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:01.554066 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:01.554549 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.555280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:01.555708 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.642591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] HTTP exception thrown: Cannot 'detach_volume' instance db5afaf8-702b-44ef-bafd-b80903345966 while it is in vm_state rescued Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Request method failure captured: Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments/74654ae2-74ad-498c-aef1-3cfba1cd2bd7 HTTP/1.1 Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABiseoMRZ-FyFa7yln6vEQlzo7lNXs7ArqF6Nvs6bxzqJ6Ojas_BdnGVED-ZosLrOF01Dg-RQtNYXr5b1sKriCfPdGX6ZelPwrEn6hlT8fdUxiZHzr3PnnsiZ40sUlyA2YQWAMoYm0tybTNR-OImRAuw_EbcgDUM_PMxqknDEqxAKLz4M8 Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:01:01.644208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8818885318b54ef6858e754d2bc4587c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 01571ac0b01845f78192269cacb23644 Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:01:01.645745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Cannot 'detach_volume' instance db5afaf8-702b-44ef-bafd-b80903345966 while it is in vm_state rescued Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'server_id': 'db5afaf8-702b-44ef-bafd-b80903345966', 'id': '74654ae2-74ad-498c-aef1-3cfba1cd2bd7'} Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db5afaf8-702b-44ef-bafd-b80903345966 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:01:01.646650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance db5afaf8-702b-44ef-bafd-b80903345966 while it is in vm_state rescued Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance db5afaf8-702b-44ef-bafd-b80903345966 while it is in vm_state rescued Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:01:01.648036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Returning 409 to user: Cannot 'detach_volume' instance db5afaf8-702b-44ef-bafd-b80903345966 while it is in vm_state rescued {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:01:01.649150 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7cf09f81-02a0-4286-93dd-b52f84a0c0c5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments/74654ae2-74ad-498c-aef1-3cfba1cd2bd7" status: 409 len: 152 microversion: 2.1 time: 0.103044 Jun 21 16:01:01.649150 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 399/782] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:01:01 2022] DELETE /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments/74654ae2-74ad-498c-aef1-3cfba1cd2bd7 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 16:01:01.654945 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-89d38214-cd7b-4449-b149-961debc5ed88 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:01.655475 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-89d38214-cd7b-4449-b149-961debc5ed88 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:01.662240 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-89d38214-cd7b-4449-b149-961debc5ed88 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:01.662689 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-89d38214-cd7b-4449-b149-961debc5ed88 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.663445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-89d38214-cd7b-4449-b149-961debc5ed88 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:01.663876 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-89d38214-cd7b-4449-b149-961debc5ed88 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.734970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-89d38214-cd7b-4449-b149-961debc5ed88 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "POST /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/action" status: 202 len: 0 microversion: 2.1 time: 0.083789 Jun 21 16:01:01.735605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 384/783] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 16:01:01 2022] POST /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:01:01.747512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c515aeac-57a3-4346-9803-5e3747a390dd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:01.748516 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c515aeac-57a3-4346-9803-5e3747a390dd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:01.757042 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c515aeac-57a3-4346-9803-5e3747a390dd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:01.757498 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c515aeac-57a3-4346-9803-5e3747a390dd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.758292 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c515aeac-57a3-4346-9803-5e3747a390dd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:01.758832 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c515aeac-57a3-4346-9803-5e3747a390dd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:01.905518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c515aeac-57a3-4346-9803-5e3747a390dd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:01.916064 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c515aeac-57a3-4346-9803-5e3747a390dd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1724 microversion: 2.1 time: 0.174803 Jun 21 16:01:01.916665 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 400/784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:01 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:02.050948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:02.051546 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:02.058120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:02.058555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:02.059310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:02.059737 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:02.078402 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2bfff5a3-9c26-4d54-85a1-2c41e59c415f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:02.079165 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2bfff5a3-9c26-4d54-85a1-2c41e59c415f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:02.086509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2bfff5a3-9c26-4d54-85a1-2c41e59c415f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:02.086947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2bfff5a3-9c26-4d54-85a1-2c41e59c415f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:02.087724 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2bfff5a3-9c26-4d54-85a1-2c41e59c415f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:02.088216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2bfff5a3-9c26-4d54-85a1-2c41e59c415f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:02.160657 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2bfff5a3-9c26-4d54-85a1-2c41e59c415f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:02.168296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2bfff5a3-9c26-4d54-85a1-2c41e59c415f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1245 microversion: 2.1 time: 0.094116 Jun 21 16:01:02.168854 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 401/785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:02 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:02.221213 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:02.230030 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:02.231528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:02.232705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c2ed1f0f-2922-4550-b536-ce285b6b368b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.188187 Jun 21 16:01:02.233275 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 385/786] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:01:02 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:01:02.944648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6ef984ec-c99c-48e7-b163-d9cdc8364b8b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:02.945402 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6ef984ec-c99c-48e7-b163-d9cdc8364b8b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:02.952812 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ef984ec-c99c-48e7-b163-d9cdc8364b8b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:02.953690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ef984ec-c99c-48e7-b163-d9cdc8364b8b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:02.954093 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ef984ec-c99c-48e7-b163-d9cdc8364b8b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:02.954531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ef984ec-c99c-48e7-b163-d9cdc8364b8b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:03.118256 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6ef984ec-c99c-48e7-b163-d9cdc8364b8b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:03.120554 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:03.128744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6ef984ec-c99c-48e7-b163-d9cdc8364b8b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1724 microversion: 2.1 time: 0.190995 Jun 21 16:01:03.129437 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 402/787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:02 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:03.186273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ef44b862-2ec7-4a63-b3fe-9c53e94ec485 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:03.186890 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ef44b862-2ec7-4a63-b3fe-9c53e94ec485 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:03.194100 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ef44b862-2ec7-4a63-b3fe-9c53e94ec485 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:03.194550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ef44b862-2ec7-4a63-b3fe-9c53e94ec485 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:03.195312 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ef44b862-2ec7-4a63-b3fe-9c53e94ec485 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:03.195739 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ef44b862-2ec7-4a63-b3fe-9c53e94ec485 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:03.253807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:03.254503 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:03.262564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:03.263032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:03.263820 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:03.264720 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:03.267143 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ef44b862-2ec7-4a63-b3fe-9c53e94ec485 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:03.275077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ef44b862-2ec7-4a63-b3fe-9c53e94ec485 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1293 microversion: 2.1 time: 0.092820 Jun 21 16:01:03.275687 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 386/788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:03 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:03.649625 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:03.658035 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:03.659991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:03.661311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b9a003ab-8d2e-4a29-87cf-fd91151ae99c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.412292 Jun 21 16:01:03.661990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 403/789] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:01:03 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:01:04.146861 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e0149846-f19b-4f7b-83d7-48971b7b6ce7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:04.147455 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e0149846-f19b-4f7b-83d7-48971b7b6ce7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:04.153803 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0149846-f19b-4f7b-83d7-48971b7b6ce7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:04.154276 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0149846-f19b-4f7b-83d7-48971b7b6ce7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:04.155060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0149846-f19b-4f7b-83d7-48971b7b6ce7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:04.155446 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e0149846-f19b-4f7b-83d7-48971b7b6ce7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:04.292969 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9a3447e7-e975-4e26-9e75-a32d167bab5f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:04.293795 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9a3447e7-e975-4e26-9e75-a32d167bab5f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:04.301901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9a3447e7-e975-4e26-9e75-a32d167bab5f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:04.302703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9a3447e7-e975-4e26-9e75-a32d167bab5f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:04.303457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9a3447e7-e975-4e26-9e75-a32d167bab5f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:04.304102 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9a3447e7-e975-4e26-9e75-a32d167bab5f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:04.589565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9a3447e7-e975-4e26-9e75-a32d167bab5f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:04.598097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9a3447e7-e975-4e26-9e75-a32d167bab5f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1299 microversion: 2.1 time: 0.309106 Jun 21 16:01:04.598666 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 404/790] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:04 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:04.637231 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e0149846-f19b-4f7b-83d7-48971b7b6ce7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:04.647342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e0149846-f19b-4f7b-83d7-48971b7b6ce7 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1724 microversion: 2.1 time: 0.504760 Jun 21 16:01:04.647935 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 387/791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:04 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1724 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:04.668772 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-bebc6af9-b2a1-4260-89f4-131f5b7d7529 req-375a4c8c-4202-481e-81a3-8ae5c2220723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cea78e9-1d9b-4b08-bbe5-93fadd09e685", "name": "network-vif-plugged", "status": "completed", "tag": "b76d21d6-4f2c-4f99-a9ef-d06b45b48736"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:04.678179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-bebc6af9-b2a1-4260-89f4-131f5b7d7529 req-375a4c8c-4202-481e-81a3-8ae5c2220723 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:04.679122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-bebc6af9-b2a1-4260-89f4-131f5b7d7529 req-375a4c8c-4202-481e-81a3-8ae5c2220723 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:04.679707 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:04.680299 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:04.686352 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:04.686788 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:04.687544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:04.688004 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:04.693613 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-bebc6af9-b2a1-4260-89f4-131f5b7d7529 req-375a4c8c-4202-481e-81a3-8ae5c2220723 service nova] Creating event network-vif-plugged:b76d21d6-4f2c-4f99-a9ef-d06b45b48736 for instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 on hv-cinder-84067 Jun 21 16:01:04.700293 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-bebc6af9-b2a1-4260-89f4-131f5b7d7529 req-375a4c8c-4202-481e-81a3-8ae5c2220723 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100504 Jun 21 16:01:04.700890 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 405/792] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:04.771510 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:04.914338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:04.922757 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:04.924441 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:04.925550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0907f1e6-f14c-4f02-8999-4e619ceff991 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.250018 Jun 21 16:01:04.926154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 388/793] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:01:04 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:01:05.619665 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fe234270-76f9-4749-b2a1-900075b718eb tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:05.620522 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fe234270-76f9-4749-b2a1-900075b718eb tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:05.629729 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe234270-76f9-4749-b2a1-900075b718eb tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:05.630219 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe234270-76f9-4749-b2a1-900075b718eb tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:05.630990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe234270-76f9-4749-b2a1-900075b718eb tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:05.631419 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe234270-76f9-4749-b2a1-900075b718eb tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:05.664928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0649550a-3f40-4954-8265-fe4dda84cf27 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:05.665513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0649550a-3f40-4954-8265-fe4dda84cf27 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:05.672207 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0649550a-3f40-4954-8265-fe4dda84cf27 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:05.672641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0649550a-3f40-4954-8265-fe4dda84cf27 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:05.673385 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0649550a-3f40-4954-8265-fe4dda84cf27 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:05.673805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0649550a-3f40-4954-8265-fe4dda84cf27 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:05.816415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fe234270-76f9-4749-b2a1-900075b718eb tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:05.824572 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fe234270-76f9-4749-b2a1-900075b718eb tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.211759 Jun 21 16:01:05.825247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 406/794] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:05 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:05.842796 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0649550a-3f40-4954-8265-fe4dda84cf27 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:05.851454 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0649550a-3f40-4954-8265-fe4dda84cf27 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1724 microversion: 2.1 time: 0.190403 Jun 21 16:01:05.852011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 389/795] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:05 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:05.944418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:05.945190 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:05.954127 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:05.954625 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:05.955616 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:05.956169 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:06.104759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:06.113737 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:06.115275 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:06.116397 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-17a4b73f-2d2d-43b4-88d0-80093c04e8e3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.176434 Jun 21 16:01:06.116929 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 407/796] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:01:05 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:01:06.843064 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bad0eee8-bf1e-4cf7-a30e-90159e39eb37 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:06.844248 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bad0eee8-bf1e-4cf7-a30e-90159e39eb37 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:06.855845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bad0eee8-bf1e-4cf7-a30e-90159e39eb37 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:06.856788 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bad0eee8-bf1e-4cf7-a30e-90159e39eb37 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:06.858011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bad0eee8-bf1e-4cf7-a30e-90159e39eb37 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:06.859419 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bad0eee8-bf1e-4cf7-a30e-90159e39eb37 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:06.874835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cdedeed0-a229-4d5e-bd20-8612c768e2a0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:06.876506 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cdedeed0-a229-4d5e-bd20-8612c768e2a0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:06.885389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cdedeed0-a229-4d5e-bd20-8612c768e2a0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:06.886010 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cdedeed0-a229-4d5e-bd20-8612c768e2a0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:06.887827 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cdedeed0-a229-4d5e-bd20-8612c768e2a0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:06.888458 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cdedeed0-a229-4d5e-bd20-8612c768e2a0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:07.107533 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-bad0eee8-bf1e-4cf7-a30e-90159e39eb37 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:07.111350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cdedeed0-a229-4d5e-bd20-8612c768e2a0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:07.115999 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bad0eee8-bf1e-4cf7-a30e-90159e39eb37 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.277535 Jun 21 16:01:07.116768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 390/797] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:06 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:01:07.121216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cdedeed0-a229-4d5e-bd20-8612c768e2a0 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1730 microversion: 2.1 time: 0.252141 Jun 21 16:01:07.122132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 408/798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:06 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:01:07.138762 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ec5c87b5-c92d-4450-aa43-22753d58ff9a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:07.139492 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ec5c87b5-c92d-4450-aa43-22753d58ff9a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:07.146880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ec5c87b5-c92d-4450-aa43-22753d58ff9a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:07.147324 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ec5c87b5-c92d-4450-aa43-22753d58ff9a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:07.148108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ec5c87b5-c92d-4450-aa43-22753d58ff9a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:07.148539 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ec5c87b5-c92d-4450-aa43-22753d58ff9a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:07.182951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-a785204e-a734-4804-8e5b-fbec9c10a2aa req-b6a06105-bfb8-44ff-9b76-714a2025db44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4c7c0a-54a2-4047-85b8-13456b2fb6b7", "tag": "e6c8b845-e0d8-422d-b238-eee6d7a2ce83"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:07.192678 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-a785204e-a734-4804-8e5b-fbec9c10a2aa req-b6a06105-bfb8-44ff-9b76-714a2025db44 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:07.193118 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-a785204e-a734-4804-8e5b-fbec9c10a2aa req-b6a06105-bfb8-44ff-9b76-714a2025db44 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:07.205176 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-a785204e-a734-4804-8e5b-fbec9c10a2aa req-b6a06105-bfb8-44ff-9b76-714a2025db44 service nova] Creating event network-changed:e6c8b845-e0d8-422d-b238-eee6d7a2ce83 for instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 on hv-cinder-84067 Jun 21 16:01:07.211624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-a785204e-a734-4804-8e5b-fbec9c10a2aa req-b6a06105-bfb8-44ff-9b76-714a2025db44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093363 Jun 21 16:01:07.212559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 391/799] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:07.218377 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:07.219628 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:07.226184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:07.226929 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:07.227463 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:07.227858 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:07.250600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ec5c87b5-c92d-4450-aa43-22753d58ff9a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115625 Jun 21 16:01:07.251642 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 409/800] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jun 21 16:01:07 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:07.488264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:07.496716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:07.498229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:07.499322 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-54429ab2-a50d-4a3c-b05c-94be8191a2f3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1406 microversion: 2.20 time: 0.285358 Jun 21 16:01:07.500291 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 392/801] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:01:07 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:01:08.134412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-61efe47c-ad8f-42cd-8fcf-8fd16c55eda6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:08.135023 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-61efe47c-ad8f-42cd-8fcf-8fd16c55eda6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:08.141376 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-61efe47c-ad8f-42cd-8fcf-8fd16c55eda6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:08.141856 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-61efe47c-ad8f-42cd-8fcf-8fd16c55eda6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:08.142623 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-61efe47c-ad8f-42cd-8fcf-8fd16c55eda6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:08.143080 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-61efe47c-ad8f-42cd-8fcf-8fd16c55eda6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:08.518085 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:08.518755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:08.526250 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:08.526693 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:08.527454 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:08.527878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:08.866898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-61efe47c-ad8f-42cd-8fcf-8fd16c55eda6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:08.874930 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-61efe47c-ad8f-42cd-8fcf-8fd16c55eda6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.745056 Jun 21 16:01:08.875698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 410/802] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:08 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:08.971097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:08.979666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:08.981130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:08.982336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d8b0817a-4d9b-4e46-b088-06d48be1b0f9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1597 microversion: 2.20 time: 0.468257 Jun 21 16:01:08.982919 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 393/803] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:01:08 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1597 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:01:09.000159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-74549a39-ca26-489a-8c10-32a1f1be6ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:09.000648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-74549a39-ca26-489a-8c10-32a1f1be6ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:09.007902 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74549a39-ca26-489a-8c10-32a1f1be6ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:09.008357 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74549a39-ca26-489a-8c10-32a1f1be6ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:09.009132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74549a39-ca26-489a-8c10-32a1f1be6ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:09.009568 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74549a39-ca26-489a-8c10-32a1f1be6ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:09.171166 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-74549a39-ca26-489a-8c10-32a1f1be6ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.175021 Jun 21 16:01:09.172415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 411/804] 10.222.0.52 () {60 vars in 1315 bytes} [Tue Jun 21 16:01:08 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:01:09.229761 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-4c9999dd-9578-464b-a773-b79755051ede req-cbcf27b4-f9e8-4ba9-8d18-f61c66386ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db5afaf8-702b-44ef-bafd-b80903345966", "tag": "d74a9552-5153-4ad9-8130-43325526cc8b"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:09.242270 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-4c9999dd-9578-464b-a773-b79755051ede req-cbcf27b4-f9e8-4ba9-8d18-f61c66386ee2 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:09.242707 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-4c9999dd-9578-464b-a773-b79755051ede req-cbcf27b4-f9e8-4ba9-8d18-f61c66386ee2 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:09.259556 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-4c9999dd-9578-464b-a773-b79755051ede req-cbcf27b4-f9e8-4ba9-8d18-f61c66386ee2 service nova] Creating event network-changed:d74a9552-5153-4ad9-8130-43325526cc8b for instance db5afaf8-702b-44ef-bafd-b80903345966 on hv-cinder-84067 Jun 21 16:01:09.264446 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-4c9999dd-9578-464b-a773-b79755051ede req-cbcf27b4-f9e8-4ba9-8d18-f61c66386ee2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038235 Jun 21 16:01:09.265240 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 394/805] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:09.889453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:09.890242 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=12 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:09.894916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9ade154b-cc57-4d7e-a7ce-526c8d751174 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:09.895521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9ade154b-cc57-4d7e-a7ce-526c8d751174 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:09.902650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ade154b-cc57-4d7e-a7ce-526c8d751174 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:09.903096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ade154b-cc57-4d7e-a7ce-526c8d751174 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:09.903903 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ade154b-cc57-4d7e-a7ce-526c8d751174 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:09.904281 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9ade154b-cc57-4d7e-a7ce-526c8d751174 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:10.045669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9ade154b-cc57-4d7e-a7ce-526c8d751174 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:10.055891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9ade154b-cc57-4d7e-a7ce-526c8d751174 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.167157 Jun 21 16:01:10.056512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 412/806] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:09 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:10.541356 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=12 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:10.545726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-de2e60a3-615c-48a2-bbd9-75929ef09ebb req-7e375ed9-3289-4d1b-8310-907067a9b4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cea78e9-1d9b-4b08-bbe5-93fadd09e685", "tag": "b76d21d6-4f2c-4f99-a9ef-d06b45b48736"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:10.555028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-de2e60a3-615c-48a2-bbd9-75929ef09ebb req-7e375ed9-3289-4d1b-8310-907067a9b4d8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:10.555461 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-de2e60a3-615c-48a2-bbd9-75929ef09ebb req-7e375ed9-3289-4d1b-8310-907067a9b4d8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:10.566921 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-de2e60a3-615c-48a2-bbd9-75929ef09ebb req-7e375ed9-3289-4d1b-8310-907067a9b4d8 service nova] Creating event network-changed:b76d21d6-4f2c-4f99-a9ef-d06b45b48736 for instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 on hv-cinder-84067 Jun 21 16:01:10.571936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-de2e60a3-615c-48a2-bbd9-75929ef09ebb req-7e375ed9-3289-4d1b-8310-907067a9b4d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031817 Jun 21 16:01:10.572520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 395/807] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:11.072651 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-35d5360e-13e0-44dd-bb92-33592efb446a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:11.073219 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-35d5360e-13e0-44dd-bb92-33592efb446a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:11.080435 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35d5360e-13e0-44dd-bb92-33592efb446a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:11.080986 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35d5360e-13e0-44dd-bb92-33592efb446a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:11.081905 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35d5360e-13e0-44dd-bb92-33592efb446a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:11.082476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35d5360e-13e0-44dd-bb92-33592efb446a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:11.218431 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-35d5360e-13e0-44dd-bb92-33592efb446a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:11.226305 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-35d5360e-13e0-44dd-bb92-33592efb446a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.157475 Jun 21 16:01:11.227112 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 413/808] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:11 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:11.283998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-947e3085-a8b0-4d47-93df-d07d6566c923 req-05275fba-8e08-4cbb-9dd5-38752b188c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db5afaf8-702b-44ef-bafd-b80903345966", "tag": "d74a9552-5153-4ad9-8130-43325526cc8b"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:11.292719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-947e3085-a8b0-4d47-93df-d07d6566c923 req-05275fba-8e08-4cbb-9dd5-38752b188c32 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:11.293157 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-947e3085-a8b0-4d47-93df-d07d6566c923 req-05275fba-8e08-4cbb-9dd5-38752b188c32 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:11.305565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-947e3085-a8b0-4d47-93df-d07d6566c923 req-05275fba-8e08-4cbb-9dd5-38752b188c32 service nova] Creating event network-changed:d74a9552-5153-4ad9-8130-43325526cc8b for instance db5afaf8-702b-44ef-bafd-b80903345966 on hv-cinder-84067 Jun 21 16:01:11.310524 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-947e3085-a8b0-4d47-93df-d07d6566c923 req-05275fba-8e08-4cbb-9dd5-38752b188c32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030831 Jun 21 16:01:11.311107 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 396/809] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:12.244120 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ff0c8ab7-e24c-456f-b0df-6db8efa8f8b9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:12.244703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ff0c8ab7-e24c-456f-b0df-6db8efa8f8b9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:12.255427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ff0c8ab7-e24c-456f-b0df-6db8efa8f8b9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:12.255868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ff0c8ab7-e24c-456f-b0df-6db8efa8f8b9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:12.256635 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ff0c8ab7-e24c-456f-b0df-6db8efa8f8b9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:12.259296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ff0c8ab7-e24c-456f-b0df-6db8efa8f8b9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:12.404611 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ff0c8ab7-e24c-456f-b0df-6db8efa8f8b9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:12.412938 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ff0c8ab7-e24c-456f-b0df-6db8efa8f8b9 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.173190 Jun 21 16:01:12.413521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 414/810] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:12 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:13.431489 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1fb597db-1b19-49f5-b7c7-65856ea81851 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:13.432234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1fb597db-1b19-49f5-b7c7-65856ea81851 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:13.439141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1fb597db-1b19-49f5-b7c7-65856ea81851 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:13.439592 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1fb597db-1b19-49f5-b7c7-65856ea81851 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:13.440363 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1fb597db-1b19-49f5-b7c7-65856ea81851 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:13.440787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1fb597db-1b19-49f5-b7c7-65856ea81851 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:13.576936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1fb597db-1b19-49f5-b7c7-65856ea81851 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:13.585285 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1fb597db-1b19-49f5-b7c7-65856ea81851 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.158798 Jun 21 16:01:13.585915 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 397/811] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:13 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:14.604318 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fc880a75-e92c-44a6-ab2f-e2aab3098d41 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:14.605041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fc880a75-e92c-44a6-ab2f-e2aab3098d41 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:14.614297 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fc880a75-e92c-44a6-ab2f-e2aab3098d41 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:14.614823 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fc880a75-e92c-44a6-ab2f-e2aab3098d41 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:14.615722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fc880a75-e92c-44a6-ab2f-e2aab3098d41 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:14.616228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fc880a75-e92c-44a6-ab2f-e2aab3098d41 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:14.758072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fc880a75-e92c-44a6-ab2f-e2aab3098d41 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:14.766222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fc880a75-e92c-44a6-ab2f-e2aab3098d41 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.166942 Jun 21 16:01:14.766789 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 415/812] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:14 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:15.784500 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ad10e01b-4e50-4e50-a553-98dd1d402a3c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:15.785119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ad10e01b-4e50-4e50-a553-98dd1d402a3c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:15.794294 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ad10e01b-4e50-4e50-a553-98dd1d402a3c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:15.794908 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ad10e01b-4e50-4e50-a553-98dd1d402a3c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:15.796023 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ad10e01b-4e50-4e50-a553-98dd1d402a3c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:15.796650 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ad10e01b-4e50-4e50-a553-98dd1d402a3c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:15.947424 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ad10e01b-4e50-4e50-a553-98dd1d402a3c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:15.951470 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:15.955787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ad10e01b-4e50-4e50-a553-98dd1d402a3c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.175867 Jun 21 16:01:15.956332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 398/813] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:15 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:16.437947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-1ab9983a-b5bc-4333-8d14-e13966209517 req-f546875c-24d6-4e28-aaee-0e3be5e553a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4c7c0a-54a2-4047-85b8-13456b2fb6b7", "name": "network-vif-plugged", "status": "completed", "tag": "e6c8b845-e0d8-422d-b238-eee6d7a2ce83"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:16.447319 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-1ab9983a-b5bc-4333-8d14-e13966209517 req-f546875c-24d6-4e28-aaee-0e3be5e553a3 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:16.447770 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-1ab9983a-b5bc-4333-8d14-e13966209517 req-f546875c-24d6-4e28-aaee-0e3be5e553a3 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:16.459785 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-1ab9983a-b5bc-4333-8d14-e13966209517 req-f546875c-24d6-4e28-aaee-0e3be5e553a3 service nova] Creating event network-vif-plugged:e6c8b845-e0d8-422d-b238-eee6d7a2ce83 for instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 on hv-cinder-84067 Jun 21 16:01:16.464836 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-1ab9983a-b5bc-4333-8d14-e13966209517 req-f546875c-24d6-4e28-aaee-0e3be5e553a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030715 Jun 21 16:01:16.465431 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 416/814] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:16.975021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-67343077-2501-49b7-95f6-79741c2dcc23 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:16.975990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-67343077-2501-49b7-95f6-79741c2dcc23 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:16.987064 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-67343077-2501-49b7-95f6-79741c2dcc23 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:16.987503 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-67343077-2501-49b7-95f6-79741c2dcc23 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:16.988263 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-67343077-2501-49b7-95f6-79741c2dcc23 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:16.988700 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-67343077-2501-49b7-95f6-79741c2dcc23 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:17.129735 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-67343077-2501-49b7-95f6-79741c2dcc23 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:17.137752 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-67343077-2501-49b7-95f6-79741c2dcc23 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.168434 Jun 21 16:01:17.138265 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 399/815] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:16 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:18.159410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-52ab8a66-258e-422a-a050-47b51b4d2123 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:18.160124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-52ab8a66-258e-422a-a050-47b51b4d2123 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:18.168250 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-52ab8a66-258e-422a-a050-47b51b4d2123 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:18.168695 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-52ab8a66-258e-422a-a050-47b51b4d2123 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:18.169456 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-52ab8a66-258e-422a-a050-47b51b4d2123 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:18.169920 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-52ab8a66-258e-422a-a050-47b51b4d2123 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:18.309641 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-52ab8a66-258e-422a-a050-47b51b4d2123 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:18.317412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-52ab8a66-258e-422a-a050-47b51b4d2123 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1366 microversion: 2.1 time: 0.165373 Jun 21 16:01:18.317994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 417/816] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:18 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:19.335960 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6685be63-f3b3-4bf2-b981-c52e72f21536 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:19.336566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6685be63-f3b3-4bf2-b981-c52e72f21536 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:19.343568 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6685be63-f3b3-4bf2-b981-c52e72f21536 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:19.344011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6685be63-f3b3-4bf2-b981-c52e72f21536 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:19.344769 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6685be63-f3b3-4bf2-b981-c52e72f21536 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:19.345198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6685be63-f3b3-4bf2-b981-c52e72f21536 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:19.490713 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6685be63-f3b3-4bf2-b981-c52e72f21536 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:19.498481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6685be63-f3b3-4bf2-b981-c52e72f21536 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1556 microversion: 2.1 time: 0.166690 Jun 21 16:01:19.499035 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 400/817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:19 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:19.517672 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ac03a396-0330-4003-b903-a271e3a3d4fa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:19.518447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ac03a396-0330-4003-b903-a271e3a3d4fa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:19.525100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ac03a396-0330-4003-b903-a271e3a3d4fa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:19.525548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ac03a396-0330-4003-b903-a271e3a3d4fa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:19.526346 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ac03a396-0330-4003-b903-a271e3a3d4fa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:19.526779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ac03a396-0330-4003-b903-a271e3a3d4fa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:19.615317 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ac03a396-0330-4003-b903-a271e3a3d4fa tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103900 Jun 21 16:01:19.615913 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 418/818] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jun 21 16:01:19 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:20.595766 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-5e7989f3-0ee5-407e-af67-a98f528828ec req-97bd361b-cc38-4e5a-bf73-a7a4aac957f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4c7c0a-54a2-4047-85b8-13456b2fb6b7", "tag": "e6c8b845-e0d8-422d-b238-eee6d7a2ce83"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:20.606562 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-5e7989f3-0ee5-407e-af67-a98f528828ec req-97bd361b-cc38-4e5a-bf73-a7a4aac957f3 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:20.607083 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-5e7989f3-0ee5-407e-af67-a98f528828ec req-97bd361b-cc38-4e5a-bf73-a7a4aac957f3 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:20.623093 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-5e7989f3-0ee5-407e-af67-a98f528828ec req-97bd361b-cc38-4e5a-bf73-a7a4aac957f3 service nova] Creating event network-changed:e6c8b845-e0d8-422d-b238-eee6d7a2ce83 for instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 on hv-cinder-84067 Jun 21 16:01:20.629578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-5e7989f3-0ee5-407e-af67-a98f528828ec req-97bd361b-cc38-4e5a-bf73-a7a4aac957f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037647 Jun 21 16:01:20.630422 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 401/819] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:37.353808 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=44 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:37.354618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=83 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:37.358862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4aaabc52-a92a-4880-9680-c3c9645d9f4a tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1394046937"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:37.359445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4aaabc52-a92a-4880-9680-c3c9645d9f4a tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:37.367430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4aaabc52-a92a-4880-9680-c3c9645d9f4a tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:37.367962 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4aaabc52-a92a-4880-9680-c3c9645d9f4a tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:37.368773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4aaabc52-a92a-4880-9680-c3c9645d9f4a tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:37.369217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4aaabc52-a92a-4880-9680-c3c9645d9f4a tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:37.506000 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.network.security_group_api [None req-4aaabc52-a92a-4880-9680-c3c9645d9f4a tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Removing security group cae86658-7211-442c-a7a8-ad76edc10415 from port e2a0a9e4-f360-48ee-8bfa-9a53de846467 Jun 21 16:01:37.869451 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4aaabc52-a92a-4880-9680-c3c9645d9f4a tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "POST /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/action" status: 202 len: 0 microversion: 2.1 time: 0.516979 Jun 21 16:01:37.885617 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-fb50415e-4b82-4681-9a25-dff7ab48a855 req-2ffb902c-ba82-4980-8f7e-ebd24a5dbb50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b86eef-f566-4e16-bcb1-779a14e4ec90", "tag": "e2a0a9e4-f360-48ee-8bfa-9a53de846467"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:37.886239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 419/820] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 16:01:37 2022] POST /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:01:37.891146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=43 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:37.892281 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=14 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:37.901695 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-fb50415e-4b82-4681-9a25-dff7ab48a855 req-2ffb902c-ba82-4980-8f7e-ebd24a5dbb50 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:37.902166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-fb50415e-4b82-4681-9a25-dff7ab48a855 req-2ffb902c-ba82-4980-8f7e-ebd24a5dbb50 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:37.919585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-fb50415e-4b82-4681-9a25-dff7ab48a855 req-2ffb902c-ba82-4980-8f7e-ebd24a5dbb50 service nova] Creating event network-changed:e2a0a9e4-f360-48ee-8bfa-9a53de846467 for instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 on hv-cinder-84067 Jun 21 16:01:37.925048 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-fb50415e-4b82-4681-9a25-dff7ab48a855 req-2ffb902c-ba82-4980-8f7e-ebd24a5dbb50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043170 Jun 21 16:01:37.928813 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 402/821] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:39.350991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-31054810-b580-4e70-a423-59b327310088 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:39.351555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-31054810-b580-4e70-a423-59b327310088 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:39.358064 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-31054810-b580-4e70-a423-59b327310088 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:39.358509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-31054810-b580-4e70-a423-59b327310088 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:39.359371 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-31054810-b580-4e70-a423-59b327310088 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:39.359850 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-31054810-b580-4e70-a423-59b327310088 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:39.446948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-31054810-b580-4e70-a423-59b327310088 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lazy-loading 'services' on Instance uuid 32b86eef-f566-4e16-bcb1-779a14e4ec90 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:01:39.527095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-31054810-b580-4e70-a423-59b327310088 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments/4d64c8c4-1519-4b81-8be9-5d8084bcb074" status: 202 len: 0 microversion: 2.1 time: 0.180636 Jun 21 16:01:39.528034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 420/822] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:01:39 2022] DELETE /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments/4d64c8c4-1519-4b81-8be9-5d8084bcb074 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:01:39.538630 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c12132c5-49a4-4226-9c37-6a813e2ed39c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:39.539615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c12132c5-49a4-4226-9c37-6a813e2ed39c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:39.547448 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c12132c5-49a4-4226-9c37-6a813e2ed39c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:39.549238 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c12132c5-49a4-4226-9c37-6a813e2ed39c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:39.550324 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c12132c5-49a4-4226-9c37-6a813e2ed39c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:39.550758 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c12132c5-49a4-4226-9c37-6a813e2ed39c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:39.585522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c12132c5-49a4-4226-9c37-6a813e2ed39c tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052165 Jun 21 16:01:39.586146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 403/823] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:01:39 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:01:39.946926 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-a295c3cb-2d31-40f4-b569-6bbcc72b1b0d req-1772cc03-6c14-4577-a297-49be3d1fdb95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b86eef-f566-4e16-bcb1-779a14e4ec90", "tag": "e2a0a9e4-f360-48ee-8bfa-9a53de846467"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:39.956361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-a295c3cb-2d31-40f4-b569-6bbcc72b1b0d req-1772cc03-6c14-4577-a297-49be3d1fdb95 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:39.956895 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-a295c3cb-2d31-40f4-b569-6bbcc72b1b0d req-1772cc03-6c14-4577-a297-49be3d1fdb95 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:39.968638 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-a295c3cb-2d31-40f4-b569-6bbcc72b1b0d req-1772cc03-6c14-4577-a297-49be3d1fdb95 service nova] Creating event network-changed:e2a0a9e4-f360-48ee-8bfa-9a53de846467 for instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 on hv-cinder-84067 Jun 21 16:01:39.974156 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-a295c3cb-2d31-40f4-b569-6bbcc72b1b0d req-1772cc03-6c14-4577-a297-49be3d1fdb95 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031337 Jun 21 16:01:39.974775 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 421/824] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:01:40.598269 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a0f77149-5c8a-42c6-a428-92b41c6a6258 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:40.599541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a0f77149-5c8a-42c6-a428-92b41c6a6258 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:40.609911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0f77149-5c8a-42c6-a428-92b41c6a6258 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:40.609911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0f77149-5c8a-42c6-a428-92b41c6a6258 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:40.611069 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0f77149-5c8a-42c6-a428-92b41c6a6258 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:40.611829 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0f77149-5c8a-42c6-a428-92b41c6a6258 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:40.652688 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a0f77149-5c8a-42c6-a428-92b41c6a6258 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059838 Jun 21 16:01:40.653638 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 404/825] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:01:40 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:41.665956 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dba58ebb-3285-4615-9c34-f8cbc89c3026 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:41.666990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dba58ebb-3285-4615-9c34-f8cbc89c3026 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:41.674929 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dba58ebb-3285-4615-9c34-f8cbc89c3026 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:41.675396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dba58ebb-3285-4615-9c34-f8cbc89c3026 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:41.676156 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dba58ebb-3285-4615-9c34-f8cbc89c3026 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:41.676586 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dba58ebb-3285-4615-9c34-f8cbc89c3026 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:41.706441 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dba58ebb-3285-4615-9c34-f8cbc89c3026 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044888 Jun 21 16:01:41.706963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 422/826] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:01:41 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:01:41.776189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:41.776810 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:41.783282 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:41.783717 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:41.784474 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:41.784898 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:41.863818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] HTTP exception thrown: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 is not attached to volume 4d64c8c4-1519-4b81-8be9-5d8084bcb074 Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Request method failure captured: Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: DELETE /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments/4d64c8c4-1519-4b81-8be9-5d8084bcb074 HTTP/1.1 Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiseo6ORVYm9Q6Lu5ayYV_1A-ZKIZp-mwJ5J94JAnF6wfIpzL4s45Z6KDPePMKhy3f7SNG9ActAhgS8qedutCRKZJPW0NnMQv0P90rJH7wOaEsboXNti0SPQfI-1_aa8HTRT8souEXPxYf2GFZEUHFiSA0wOFncAQa7J1vMeNbQ1kXdsM Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8716150d618c402fbb51a2a042c5ea5b Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-TestMinimumBasicScenario-649802888 Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:01:41.866365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8716150d618c402fbb51a2a042c5ea5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8716150d618c402fbb51a2a042c5ea5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8716150d618c402fbb51a2a042c5ea5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8716150d618c402fbb51a2a042c5ea5b", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-TestMinimumBasicScenario-649802888 Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8716150d618c402fbb51a2a042c5ea5b Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-TestMinimumBasicScenario-649802888 Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-TestMinimumBasicScenario-649802888-project Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: cc3f66be61f54ea8bac135cf7b3531dc Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-TestMinimumBasicScenario-649802888-project Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:01:41.867938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 is not attached to volume 4d64c8c4-1519-4b81-8be9-5d8084bcb074 Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'server_id': '32b86eef-f566-4e16-bcb1-779a14e4ec90', 'id': '4d64c8c4-1519-4b81-8be9-5d8084bcb074'} Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4d64c8c4-1519-4b81-8be9-5d8084bcb074. Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:01:41.868903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 is not attached to volume 4d64c8c4-1519-4b81-8be9-5d8084bcb074 Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 is not attached to volume 4d64c8c4-1519-4b81-8be9-5d8084bcb074 Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:41.870173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Returning 404 to user: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 is not attached to volume 4d64c8c4-1519-4b81-8be9-5d8084bcb074 {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:01:41.871298 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-19cc222f-938d-4e0c-86db-2b6f2c812261 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments/4d64c8c4-1519-4b81-8be9-5d8084bcb074" status: 404 len: 154 microversion: 2.1 time: 0.095980 Jun 21 16:01:41.871298 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 405/827] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:01:41 2022] DELETE /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90/os-volume_attachments/4d64c8c4-1519-4b81-8be9-5d8084bcb074 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:01:43.018326 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a53c2869-f224-4131-9419-63f08fa4de76 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:43.018863 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a53c2869-f224-4131-9419-63f08fa4de76 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:43.025515 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a53c2869-f224-4131-9419-63f08fa4de76 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:43.026008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a53c2869-f224-4131-9419-63f08fa4de76 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:43.026763 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a53c2869-f224-4131-9419-63f08fa4de76 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:43.027192 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a53c2869-f224-4131-9419-63f08fa4de76 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:43.052356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a53c2869-f224-4131-9419-63f08fa4de76 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:01:43.141842 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a53c2869-f224-4131-9419-63f08fa4de76 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 204 len: 0 microversion: 2.1 time: 0.127363 Jun 21 16:01:43.143270 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 423/828] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:01:43 2022] DELETE /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:01:43.152728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-23db4b40-6fed-4378-a08b-39d995934bc2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:43.153306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-23db4b40-6fed-4378-a08b-39d995934bc2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:43.160538 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-23db4b40-6fed-4378-a08b-39d995934bc2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:43.160981 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-23db4b40-6fed-4378-a08b-39d995934bc2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:43.161738 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-23db4b40-6fed-4378-a08b-39d995934bc2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:43.162199 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-23db4b40-6fed-4378-a08b-39d995934bc2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:43.306160 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-23db4b40-6fed-4378-a08b-39d995934bc2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:43.314235 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-23db4b40-6fed-4378-a08b-39d995934bc2 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1554 microversion: 2.1 time: 0.165012 Jun 21 16:01:43.315177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 406/829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:43 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:44.333161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d82743b2-5fa6-4cf7-9326-04c13cae0717 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:44.333883 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d82743b2-5fa6-4cf7-9326-04c13cae0717 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:44.340870 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d82743b2-5fa6-4cf7-9326-04c13cae0717 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:44.341309 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d82743b2-5fa6-4cf7-9326-04c13cae0717 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:44.342182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d82743b2-5fa6-4cf7-9326-04c13cae0717 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:44.342612 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d82743b2-5fa6-4cf7-9326-04c13cae0717 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:44.480049 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d82743b2-5fa6-4cf7-9326-04c13cae0717 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:44.488437 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d82743b2-5fa6-4cf7-9326-04c13cae0717 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1554 microversion: 2.1 time: 0.159631 Jun 21 16:01:44.489015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 424/830] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:44 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:45.507140 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3fa858b8-9011-402d-b600-adbde2bde453 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:45.508445 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3fa858b8-9011-402d-b600-adbde2bde453 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:45.518497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3fa858b8-9011-402d-b600-adbde2bde453 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:45.518939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3fa858b8-9011-402d-b600-adbde2bde453 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:45.519718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3fa858b8-9011-402d-b600-adbde2bde453 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:45.520177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3fa858b8-9011-402d-b600-adbde2bde453 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:45.676289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3fa858b8-9011-402d-b600-adbde2bde453 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3f66be61f54ea8bac135cf7b3531dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8716150d618c402fbb51a2a042c5ea5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:01:45.684539 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3fa858b8-9011-402d-b600-adbde2bde453 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 200 len: 1554 microversion: 2.1 time: 0.182343 Jun 21 16:01:45.685107 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 407/831] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:45 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:01:46.046673 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-514d1533-31b7-4f30-bcbc-fae8df1df8d9 req-bc3ce878-044b-48ab-a9d2-8fe6932f9fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b86eef-f566-4e16-bcb1-779a14e4ec90", "name": "network-vif-deleted", "tag": "e2a0a9e4-f360-48ee-8bfa-9a53de846467"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:01:46.059306 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-514d1533-31b7-4f30-bcbc-fae8df1df8d9 req-bc3ce878-044b-48ab-a9d2-8fe6932f9fce service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:46.059726 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-514d1533-31b7-4f30-bcbc-fae8df1df8d9 req-bc3ce878-044b-48ab-a9d2-8fe6932f9fce service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:46.073674 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-514d1533-31b7-4f30-bcbc-fae8df1df8d9 req-bc3ce878-044b-48ab-a9d2-8fe6932f9fce service nova] Creating event network-vif-deleted:e2a0a9e4-f360-48ee-8bfa-9a53de846467 for instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 on hv-cinder-84067 Jun 21 16:01:46.081137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-514d1533-31b7-4f30-bcbc-fae8df1df8d9 req-bc3ce878-044b-48ab-a9d2-8fe6932f9fce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038064 Jun 21 16:01:46.082280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 425/832] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:01:46.703655 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:46.704252 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] [instance: 32b86eef-f566-4e16-bcb1-779a14e4ec90] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:01:46.711361 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:46.711800 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:46.712570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:01:46.713009 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:01:46.727621 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] HTTP exception thrown: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 could not be found. Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Request method failure captured: Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 HTTP/1.1 Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiseo6ORVYm9Q6Lu5ayYV_1A-ZKIZp-mwJ5J94JAnF6wfIpzL4s45Z6KDPePMKhy3f7SNG9ActAhgS8qedutCRKZJPW0NnMQv0P90rJH7wOaEsboXNti0SPQfI-1_aa8HTRT8souEXPxYf2GFZEUHFiSA0wOFncAQa7J1vMeNbQ1kXdsM Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8716150d618c402fbb51a2a042c5ea5b Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-TestMinimumBasicScenario-649802888 Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:01:46.729146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8716150d618c402fbb51a2a042c5ea5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8716150d618c402fbb51a2a042c5ea5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8716150d618c402fbb51a2a042c5ea5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8716150d618c402fbb51a2a042c5ea5b", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-TestMinimumBasicScenario-649802888 Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8716150d618c402fbb51a2a042c5ea5b Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-TestMinimumBasicScenario-649802888 Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-TestMinimumBasicScenario-649802888-project Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: cc3f66be61f54ea8bac135cf7b3531dc Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-TestMinimumBasicScenario-649802888-project Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 could not be found. Jun 21 16:01:46.730676 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '32b86eef-f566-4e16-bcb1-779a14e4ec90'} Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 could not be found. Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:01:46.731585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 could not be found. Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 could not be found. Jun 21 16:01:46.732762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:01:46.733852 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Returning 404 to user: Instance 32b86eef-f566-4e16-bcb1-779a14e4ec90 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:01:46.733852 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-98662b96-8767-472f-847b-051517ca63bb tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90" status: 404 len: 111 microversion: 2.1 time: 0.030988 Jun 21 16:01:46.733852 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 408/833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:01:46 2022] GET /compute/v2.1/servers/32b86eef-f566-4e16-bcb1-779a14e4ec90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:01:46.740505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-32a85ed2-ed6d-43bf-ad35-7477af027b68 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] Calling method '.version_select at 0x7f73b5c5eca0>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:01:46.762884 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-32a85ed2-ed6d-43bf-ad35-7477af027b68 tempest-TestMinimumBasicScenario-649802888 tempest-TestMinimumBasicScenario-649802888-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1663921589" status: 202 len: 0 microversion: 2.1 time: 0.026797 Jun 21 16:01:46.763840 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 426/834] 10.222.0.52 () {58 vars in 1271 bytes} [Tue Jun 21 16:01:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1663921589 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:02:05.649743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=14 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:05.650509 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=34 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:05.879050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4dd4b055-62f9-477f-987d-1c95f663215e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Action: 'create', calling method: .version_select at 0x7f73b5d38a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-877953109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCITiCL+mee9XjLjHmvd0TEJy6wjr462dNmcIJWt97OYHLMjlE+pJBPVOtHKuT7YBn1KLmp6JDR+H30+0i6oSs+WwOuBmcJkbbaZTjam2HoAZoFvlLx24NJ5/flVLXdf8w=="}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:05.894342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-4dd4b055-62f9-477f-987d-1c95f663215e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Getting quotas for project 658a35680c70498db2bccc1085c22b21. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:02:05.898733 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-4dd4b055-62f9-477f-987d-1c95f663215e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Getting quotas for user 0943474b3d4d49d7973619388dab2be1 and project 658a35680c70498db2bccc1085c22b21. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:02:05.928294 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4dd4b055-62f9-477f-987d-1c95f663215e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.283829 Jun 21 16:02:05.928994 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 409/835] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 16:02:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:06.060578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:06.061608 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:06.066446 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-75e385d1-cb10-4d49-bbb7-e7271a86f22b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:06.067542 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-75e385d1-cb10-4d49-bbb7-e7271a86f22b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:06.081993 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-75e385d1-cb10-4d49-bbb7-e7271a86f22b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:06.083035 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-75e385d1-cb10-4d49-bbb7-e7271a86f22b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:06.083247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-75e385d1-cb10-4d49-bbb7-e7271a86f22b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:06.083608 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-75e385d1-cb10-4d49-bbb7-e7271a86f22b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:06.118362 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-75e385d1-cb10-4d49-bbb7-e7271a86f22b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059448 Jun 21 16:02:06.118934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 427/836] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:02:06 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:02:06.179766 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dd3c9fcd-fc76-4f8e-b4a6-1cbf3ff6d44a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:06.180234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dd3c9fcd-fc76-4f8e-b4a6-1cbf3ff6d44a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:06.186601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dd3c9fcd-fc76-4f8e-b4a6-1cbf3ff6d44a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:06.187166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dd3c9fcd-fc76-4f8e-b4a6-1cbf3ff6d44a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:06.188649 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dd3c9fcd-fc76-4f8e-b4a6-1cbf3ff6d44a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:06.189997 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dd3c9fcd-fc76-4f8e-b4a6-1cbf3ff6d44a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:06.219727 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dd3c9fcd-fc76-4f8e-b4a6-1cbf3ff6d44a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:02:06.307000 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dd3c9fcd-fc76-4f8e-b4a6-1cbf3ff6d44a tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 204 len: 0 microversion: 2.1 time: 0.130866 Jun 21 16:02:06.310701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 410/837] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:02:06 2022] DELETE /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:02:06.316338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4f4fd78b-9b8d-47ec-99ad-ceb5362f1dce tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:06.316945 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4f4fd78b-9b8d-47ec-99ad-ceb5362f1dce tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:06.324114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4f4fd78b-9b8d-47ec-99ad-ceb5362f1dce tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:06.324891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4f4fd78b-9b8d-47ec-99ad-ceb5362f1dce tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:06.326105 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4f4fd78b-9b8d-47ec-99ad-ceb5362f1dce tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:06.326461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4f4fd78b-9b8d-47ec-99ad-ceb5362f1dce tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:06.518430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4f4fd78b-9b8d-47ec-99ad-ceb5362f1dce tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:06.531402 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4f4fd78b-9b8d-47ec-99ad-ceb5362f1dce tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1673 microversion: 2.1 time: 0.219141 Jun 21 16:02:06.532724 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 428/838] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:06 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:07.552578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-20175755-eafd-41c7-abf3-8395c09d8412 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:07.553273 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-20175755-eafd-41c7-abf3-8395c09d8412 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:07.559878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-20175755-eafd-41c7-abf3-8395c09d8412 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:07.560316 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-20175755-eafd-41c7-abf3-8395c09d8412 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:07.561068 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-20175755-eafd-41c7-abf3-8395c09d8412 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:07.561490 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-20175755-eafd-41c7-abf3-8395c09d8412 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:07.707237 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-20175755-eafd-41c7-abf3-8395c09d8412 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:07.715342 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-20175755-eafd-41c7-abf3-8395c09d8412 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1673 microversion: 2.1 time: 0.168991 Jun 21 16:02:07.716028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 411/839] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:07 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:08.745720 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ce93fc75-43f8-46bc-8a8b-e9ea9b470ff8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:08.746806 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ce93fc75-43f8-46bc-8a8b-e9ea9b470ff8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:08.767046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ce93fc75-43f8-46bc-8a8b-e9ea9b470ff8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:08.767812 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ce93fc75-43f8-46bc-8a8b-e9ea9b470ff8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:08.769566 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ce93fc75-43f8-46bc-8a8b-e9ea9b470ff8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:08.774374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ce93fc75-43f8-46bc-8a8b-e9ea9b470ff8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:08.881233 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-aabe4090-2793-43f6-939b-d56962a0234c req-634b4b35-b6a4-4691-96dc-42a92346e97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f494bc-2b5c-48f9-9842-5982a0d81192", "name": "network-vif-deleted", "tag": "c891b3c8-5701-448e-86d1-f82bb6aa0a97"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:08.894877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-aabe4090-2793-43f6-939b-d56962a0234c req-634b4b35-b6a4-4691-96dc-42a92346e97d service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:08.895599 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-aabe4090-2793-43f6-939b-d56962a0234c req-634b4b35-b6a4-4691-96dc-42a92346e97d service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:08.907970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-aabe4090-2793-43f6-939b-d56962a0234c req-634b4b35-b6a4-4691-96dc-42a92346e97d service nova] Creating event network-vif-deleted:c891b3c8-5701-448e-86d1-f82bb6aa0a97 for instance c6f494bc-2b5c-48f9-9842-5982a0d81192 on hv-cinder-84067 Jun 21 16:02:08.913480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-aabe4090-2793-43f6-939b-d56962a0234c req-634b4b35-b6a4-4691-96dc-42a92346e97d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035833 Jun 21 16:02:08.914639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ce93fc75-43f8-46bc-8a8b-e9ea9b470ff8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:08.914892 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 412/840] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:08.928304 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ce93fc75-43f8-46bc-8a8b-e9ea9b470ff8 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 200 len: 1606 microversion: 2.1 time: 0.197527 Jun 21 16:02:08.929364 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 429/841] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:08 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 1606 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:09.948843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:09.949631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:09.956961 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:09.957481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:09.958383 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:09.958809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:09.974776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] HTTP exception thrown: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Request method failure captured: Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 HTTP/1.1 Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemEHj1PQfeyonPC5JhAMnvCJaBYPt7Bxh2KpgSGT-0GJo-Ki13Vu06q1KXcGThnz8KWiwakrA7uN6z2Bvbo08JEdQxNCvnUIpo7-zEwmTIhnhAjuYn1qgfVH6wDk_yWs3TZ4V1wkm_ndbz9GWwwIsXG9oc7TJObZ-EaDj9taalbNL0 Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:02:09.976420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f35c94371b44c6936b1e713a398f1c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: fa5a48626c934dc2aa4f24002970b6d5 Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:02:09.977982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'c6f494bc-2b5c-48f9-9842-5982a0d81192'} Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:02:09.978808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:02:09.980244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:09.981517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Returning 404 to user: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:02:09.981517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5df42477-f3b2-4f1f-8a6e-0f765e64e1a0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 404 len: 111 microversion: 2.1 time: 0.034101 Jun 21 16:02:09.981517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 413/842] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:09 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:02:09.989102 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7921af4b-2ef2-4f27-af28-b84f3c872911 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '.version_select at 0x7f73b5c5e310>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:10.013382 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7921af4b-2ef2-4f27-af28-b84f3c872911 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911271104" status: 202 len: 0 microversion: 2.1 time: 0.027834 Jun 21 16:02:10.014602 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 430/843] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jun 21 16:02:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911271104 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:02:10.712131 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-cfc68324-604c-4aa2-a0ae-c8b0639151e7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'create', calling method: .version_select at 0x7f73b5d4e0d0>, body: {"keypair": {"name": "tempest-keypair-2072688377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKICqodBiiX/XQF8iPnn4DGc5/YGgfKEQ2FiPXsUUrFO87E7GQdaouTOFOmxGZ3Fkac3xDQmxpwjw6ifrsOlTHjDq3twwSUTeKWJXEhO9+IpCWU3oqiZV8JJVMtcDdqJqw=="}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:10.731907 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-cfc68324-604c-4aa2-a0ae-c8b0639151e7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Getting quotas for project 74f35c94371b44c6936b1e713a398f1c. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:02:10.738106 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-cfc68324-604c-4aa2-a0ae-c8b0639151e7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Getting quotas for user fa5a48626c934dc2aa4f24002970b6d5 and project 74f35c94371b44c6936b1e713a398f1c. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:02:10.766703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-cfc68324-604c-4aa2-a0ae-c8b0639151e7 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058244 Jun 21 16:02:10.767258 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 414/844] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 16:02:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:12.189991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1916608376", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0812354c-f08e-4f75-b2a2-092d36277eea"}], "security_groups": [{"name": "tempest-securitygroup--1405136584"}], "key_name": "tempest-keypair-2072688377", "user_data": "}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:12.299779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] validate_networks() for [('0812354c-f08e-4f75-b2a2-092d36277eea', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:02:12.968951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:02:12.969226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:02:12.969851 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:02:12.970253 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:02:12.970650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:02:12.980409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:12.980862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:12.981655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:12.982131 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:13.001942 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Getting quotas for project 74f35c94371b44c6936b1e713a398f1c. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:02:13.007100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Getting quotas for user fa5a48626c934dc2aa4f24002970b6d5 and project 74f35c94371b44c6936b1e713a398f1c. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:02:13.021151 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:02:13.023647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:02:13.072593 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-641b6625-93c6-411a-b12d-c169779dfd0e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.887429 Jun 21 16:02:13.073204 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 431/845] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:02:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:02:13.084630 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e2faf610-f723-4b4f-96e5-ff588b84a534 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:13.085348 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e2faf610-f723-4b4f-96e5-ff588b84a534 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:13.149497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e2faf610-f723-4b4f-96e5-ff588b84a534 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:13.157368 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e2faf610-f723-4b4f-96e5-ff588b84a534 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1238 microversion: 2.1 time: 0.077183 Jun 21 16:02:13.158074 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 415/846] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:13 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:14.175773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-59ba27b1-f4b8-4b71-a920-3a8f7b9d8c26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:14.176487 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-59ba27b1-f4b8-4b71-a920-3a8f7b9d8c26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:14.183977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59ba27b1-f4b8-4b71-a920-3a8f7b9d8c26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:14.183977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59ba27b1-f4b8-4b71-a920-3a8f7b9d8c26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:14.183977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59ba27b1-f4b8-4b71-a920-3a8f7b9d8c26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:14.185844 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59ba27b1-f4b8-4b71-a920-3a8f7b9d8c26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:14.259695 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-59ba27b1-f4b8-4b71-a920-3a8f7b9d8c26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:14.265763 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-59ba27b1-f4b8-4b71-a920-3a8f7b9d8c26 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1296 microversion: 2.1 time: 0.094870 Jun 21 16:02:14.266324 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 432/847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:14 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:15.283775 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a208a253-a1ce-45f6-85ec-aa3d673f4454 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:15.284460 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a208a253-a1ce-45f6-85ec-aa3d673f4454 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:15.291306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a208a253-a1ce-45f6-85ec-aa3d673f4454 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:15.291818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a208a253-a1ce-45f6-85ec-aa3d673f4454 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:15.292653 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a208a253-a1ce-45f6-85ec-aa3d673f4454 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:15.293253 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a208a253-a1ce-45f6-85ec-aa3d673f4454 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:15.462662 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a208a253-a1ce-45f6-85ec-aa3d673f4454 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:15.470603 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a208a253-a1ce-45f6-85ec-aa3d673f4454 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.191322 Jun 21 16:02:15.471192 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 416/848] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:15 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:15.616009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-0a221197-8ad5-4862-8941-7caac385fb7d req-e6d86794-706c-435c-a917-8a80527377c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb680b25-924b-466f-bdbf-296cb1945f93", "tag": "acee8f33-cfa6-4297-bcd4-5a348de1fe92"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:15.635255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0a221197-8ad5-4862-8941-7caac385fb7d req-e6d86794-706c-435c-a917-8a80527377c8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:15.636635 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0a221197-8ad5-4862-8941-7caac385fb7d req-e6d86794-706c-435c-a917-8a80527377c8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:15.651575 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-0a221197-8ad5-4862-8941-7caac385fb7d req-e6d86794-706c-435c-a917-8a80527377c8 service nova] Creating event network-changed:acee8f33-cfa6-4297-bcd4-5a348de1fe92 for instance fb680b25-924b-466f-bdbf-296cb1945f93 on hv-cinder-84067 Jun 21 16:02:15.657869 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-0a221197-8ad5-4862-8941-7caac385fb7d req-e6d86794-706c-435c-a917-8a80527377c8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045235 Jun 21 16:02:15.658506 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 433/849] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:16.489365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-cb438fc4-1388-497a-b726-80f817cff89c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:16.490012 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-cb438fc4-1388-497a-b726-80f817cff89c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:16.497469 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cb438fc4-1388-497a-b726-80f817cff89c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:16.498003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cb438fc4-1388-497a-b726-80f817cff89c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:16.498838 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cb438fc4-1388-497a-b726-80f817cff89c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:16.499402 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cb438fc4-1388-497a-b726-80f817cff89c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:16.635851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cb438fc4-1388-497a-b726-80f817cff89c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:16.644061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-cb438fc4-1388-497a-b726-80f817cff89c tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.159932 Jun 21 16:02:16.644633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 417/850] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:16 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:17.663403 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2a050fa3-f523-4fa3-9cb4-5bccf5e5cc74 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:17.664025 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2a050fa3-f523-4fa3-9cb4-5bccf5e5cc74 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:17.671159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2a050fa3-f523-4fa3-9cb4-5bccf5e5cc74 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:17.671744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2a050fa3-f523-4fa3-9cb4-5bccf5e5cc74 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:17.672622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2a050fa3-f523-4fa3-9cb4-5bccf5e5cc74 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:17.673048 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2a050fa3-f523-4fa3-9cb4-5bccf5e5cc74 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:17.827955 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2a050fa3-f523-4fa3-9cb4-5bccf5e5cc74 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:17.837700 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2a050fa3-f523-4fa3-9cb4-5bccf5e5cc74 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.178705 Jun 21 16:02:17.838551 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 434/851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:17 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:18.857928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-90995e9a-66f7-4c8d-ae96-0a4da81640eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:18.859102 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-90995e9a-66f7-4c8d-ae96-0a4da81640eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:18.867669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90995e9a-66f7-4c8d-ae96-0a4da81640eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:18.867669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90995e9a-66f7-4c8d-ae96-0a4da81640eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:18.867669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90995e9a-66f7-4c8d-ae96-0a4da81640eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:18.867669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90995e9a-66f7-4c8d-ae96-0a4da81640eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:19.015559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-90995e9a-66f7-4c8d-ae96-0a4da81640eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:19.024029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-90995e9a-66f7-4c8d-ae96-0a4da81640eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.170015 Jun 21 16:02:19.024029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 418/852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:18 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:20.040674 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-639a658d-f200-48e2-a5a0-c2163deaa042 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:20.041259 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-639a658d-f200-48e2-a5a0-c2163deaa042 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:20.049295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-639a658d-f200-48e2-a5a0-c2163deaa042 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:20.049748 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-639a658d-f200-48e2-a5a0-c2163deaa042 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:20.050549 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-639a658d-f200-48e2-a5a0-c2163deaa042 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:20.050984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-639a658d-f200-48e2-a5a0-c2163deaa042 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:20.192150 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-639a658d-f200-48e2-a5a0-c2163deaa042 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:20.200570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-639a658d-f200-48e2-a5a0-c2163deaa042 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.163854 Jun 21 16:02:20.201709 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 435/853] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:20 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:21.219276 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-46c14ee7-1de4-416c-9bb2-e4ed35e140c1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:21.219898 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-46c14ee7-1de4-416c-9bb2-e4ed35e140c1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:21.226853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-46c14ee7-1de4-416c-9bb2-e4ed35e140c1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:21.226990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-46c14ee7-1de4-416c-9bb2-e4ed35e140c1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:21.228034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-46c14ee7-1de4-416c-9bb2-e4ed35e140c1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:21.228642 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-46c14ee7-1de4-416c-9bb2-e4ed35e140c1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:21.366929 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-46c14ee7-1de4-416c-9bb2-e4ed35e140c1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:21.374941 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-46c14ee7-1de4-416c-9bb2-e4ed35e140c1 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.160286 Jun 21 16:02:21.375553 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 419/854] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:21 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:22.400015 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fe19ee47-92e3-45b0-9094-55fb076c7c98 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:22.400772 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fe19ee47-92e3-45b0-9094-55fb076c7c98 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:22.410563 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe19ee47-92e3-45b0-9094-55fb076c7c98 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:22.411008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe19ee47-92e3-45b0-9094-55fb076c7c98 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:22.411769 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe19ee47-92e3-45b0-9094-55fb076c7c98 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:22.412567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe19ee47-92e3-45b0-9094-55fb076c7c98 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:22.551443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fe19ee47-92e3-45b0-9094-55fb076c7c98 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:22.559366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fe19ee47-92e3-45b0-9094-55fb076c7c98 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.165730 Jun 21 16:02:22.559954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 436/855] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:22 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:22.779785 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-b9f105e5-320f-48c6-8ae9-44b83721c832 req-c82b54db-e692-4d75-92a9-f94d6584e50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb680b25-924b-466f-bdbf-296cb1945f93", "name": "network-vif-plugged", "status": "completed", "tag": "acee8f33-cfa6-4297-bcd4-5a348de1fe92"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:22.789977 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-b9f105e5-320f-48c6-8ae9-44b83721c832 req-c82b54db-e692-4d75-92a9-f94d6584e50e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:22.791080 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-b9f105e5-320f-48c6-8ae9-44b83721c832 req-c82b54db-e692-4d75-92a9-f94d6584e50e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:22.803184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-b9f105e5-320f-48c6-8ae9-44b83721c832 req-c82b54db-e692-4d75-92a9-f94d6584e50e service nova] Creating event network-vif-plugged:acee8f33-cfa6-4297-bcd4-5a348de1fe92 for instance fb680b25-924b-466f-bdbf-296cb1945f93 on hv-cinder-84067 Jun 21 16:02:22.808488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-b9f105e5-320f-48c6-8ae9-44b83721c832 req-c82b54db-e692-4d75-92a9-f94d6584e50e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032411 Jun 21 16:02:22.809085 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 420/856] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:23.577381 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f2e1961e-1965-40a0-87d9-d747b046dd21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:23.577984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f2e1961e-1965-40a0-87d9-d747b046dd21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:23.579933 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:23.580595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=6 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:23.587587 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f2e1961e-1965-40a0-87d9-d747b046dd21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:23.588034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f2e1961e-1965-40a0-87d9-d747b046dd21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:23.588836 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f2e1961e-1965-40a0-87d9-d747b046dd21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:23.589266 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f2e1961e-1965-40a0-87d9-d747b046dd21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:23.746795 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f2e1961e-1965-40a0-87d9-d747b046dd21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:23.755138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f2e1961e-1965-40a0-87d9-d747b046dd21 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.181926 Jun 21 16:02:23.756057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 437/857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:23 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:24.773795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=10 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:24.778548 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-aec4be33-2617-4323-802c-c685a4b7f520 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:24.779237 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-aec4be33-2617-4323-802c-c685a4b7f520 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:24.785887 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aec4be33-2617-4323-802c-c685a4b7f520 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:24.786539 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aec4be33-2617-4323-802c-c685a4b7f520 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:24.787071 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aec4be33-2617-4323-802c-c685a4b7f520 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:24.787500 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-aec4be33-2617-4323-802c-c685a4b7f520 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:24.930582 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-aec4be33-2617-4323-802c-c685a4b7f520 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:24.938477 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-aec4be33-2617-4323-802c-c685a4b7f520 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1364 microversion: 2.1 time: 0.165670 Jun 21 16:02:24.939021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 421/858] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:24 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:25.195480 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3754a4e6-9b91-4aca-8aea-dcc5888e7a29 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:25.196070 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3754a4e6-9b91-4aca-8aea-dcc5888e7a29 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:25.202872 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3754a4e6-9b91-4aca-8aea-dcc5888e7a29 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:25.203328 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3754a4e6-9b91-4aca-8aea-dcc5888e7a29 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:25.204073 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3754a4e6-9b91-4aca-8aea-dcc5888e7a29 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:25.204495 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3754a4e6-9b91-4aca-8aea-dcc5888e7a29 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:25.295447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-3754a4e6-9b91-4aca-8aea-dcc5888e7a29 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lazy-loading 'services' on Instance uuid db5afaf8-702b-44ef-bafd-b80903345966 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:02:25.372278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3754a4e6-9b91-4aca-8aea-dcc5888e7a29 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments/74654ae2-74ad-498c-aef1-3cfba1cd2bd7" status: 202 len: 0 microversion: 2.1 time: 0.182017 Jun 21 16:02:25.372909 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 438/859] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:02:25 2022] DELETE /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments/74654ae2-74ad-498c-aef1-3cfba1cd2bd7 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:02:25.381704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5bdc4755-436d-43f1-8bda-6ee568d7d58a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:25.382582 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5bdc4755-436d-43f1-8bda-6ee568d7d58a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:25.389044 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5bdc4755-436d-43f1-8bda-6ee568d7d58a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:25.389609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5bdc4755-436d-43f1-8bda-6ee568d7d58a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:25.390487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5bdc4755-436d-43f1-8bda-6ee568d7d58a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:25.391098 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5bdc4755-436d-43f1-8bda-6ee568d7d58a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:25.422934 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5bdc4755-436d-43f1-8bda-6ee568d7d58a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Jun 21 16:02:25.423565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 422/860] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:02:25 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:25.959255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-86425d9b-b5e7-4058-9e79-93f1d97606b0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:25.960229 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-86425d9b-b5e7-4058-9e79-93f1d97606b0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:25.969305 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86425d9b-b5e7-4058-9e79-93f1d97606b0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:25.969954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86425d9b-b5e7-4058-9e79-93f1d97606b0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:25.970948 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86425d9b-b5e7-4058-9e79-93f1d97606b0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:25.971580 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-86425d9b-b5e7-4058-9e79-93f1d97606b0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.115665 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-86425d9b-b5e7-4058-9e79-93f1d97606b0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:26.123800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-86425d9b-b5e7-4058-9e79-93f1d97606b0 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1549 microversion: 2.1 time: 0.170354 Jun 21 16:02:26.124388 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 439/861] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:25 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:26.140663 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-82a1b517-b8bd-46d6-b386-126684368099 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:26.141182 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-82a1b517-b8bd-46d6-b386-126684368099 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:26.148148 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-82a1b517-b8bd-46d6-b386-126684368099 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:26.148624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-82a1b517-b8bd-46d6-b386-126684368099 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.149380 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-82a1b517-b8bd-46d6-b386-126684368099 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:26.149857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-82a1b517-b8bd-46d6-b386-126684368099 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.248403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-82a1b517-b8bd-46d6-b386-126684368099 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110940 Jun 21 16:02:26.249344 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 423/862] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jun 21 16:02:26 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:26.435984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a52af7ea-e7c6-40ea-b3f0-95a9dbdb5a20 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:26.436438 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a52af7ea-e7c6-40ea-b3f0-95a9dbdb5a20 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:26.443028 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a52af7ea-e7c6-40ea-b3f0-95a9dbdb5a20 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:26.443622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a52af7ea-e7c6-40ea-b3f0-95a9dbdb5a20 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.444947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a52af7ea-e7c6-40ea-b3f0-95a9dbdb5a20 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:26.445436 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a52af7ea-e7c6-40ea-b3f0-95a9dbdb5a20 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.476770 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a52af7ea-e7c6-40ea-b3f0-95a9dbdb5a20 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045606 Jun 21 16:02:26.477316 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 440/863] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:02:26 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:02:26.564720 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5cebb49a-083c-4dd4-b6a7-2ddfdaf1e57b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:26.565208 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5cebb49a-083c-4dd4-b6a7-2ddfdaf1e57b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:26.573093 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5cebb49a-083c-4dd4-b6a7-2ddfdaf1e57b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:26.573534 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5cebb49a-083c-4dd4-b6a7-2ddfdaf1e57b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.574326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5cebb49a-083c-4dd4-b6a7-2ddfdaf1e57b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:26.574746 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5cebb49a-083c-4dd4-b6a7-2ddfdaf1e57b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.603701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5cebb49a-083c-4dd4-b6a7-2ddfdaf1e57b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:02:26.689631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5cebb49a-083c-4dd4-b6a7-2ddfdaf1e57b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 204 len: 0 microversion: 2.1 time: 0.128623 Jun 21 16:02:26.690401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 424/864] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:02:26 2022] DELETE /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:02:26.699049 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1e88cd49-bd09-484c-8f87-abff165d7f38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:26.699651 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1e88cd49-bd09-484c-8f87-abff165d7f38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:26.706331 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e88cd49-bd09-484c-8f87-abff165d7f38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:26.706784 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e88cd49-bd09-484c-8f87-abff165d7f38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.707571 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e88cd49-bd09-484c-8f87-abff165d7f38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:26.707986 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1e88cd49-bd09-484c-8f87-abff165d7f38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:26.847253 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1e88cd49-bd09-484c-8f87-abff165d7f38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:26.856076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1e88cd49-bd09-484c-8f87-abff165d7f38 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1690 microversion: 2.1 time: 0.161201 Jun 21 16:02:26.856676 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 441/865] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:26 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:27.532556 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-75bfff59-ad15-476b-b299-a4e1d8639270 req-e4c1def6-2c50-4b71-aee8-b9719d550498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb680b25-924b-466f-bdbf-296cb1945f93", "tag": "acee8f33-cfa6-4297-bcd4-5a348de1fe92"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:27.541967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-75bfff59-ad15-476b-b299-a4e1d8639270 req-e4c1def6-2c50-4b71-aee8-b9719d550498 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:27.542403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-75bfff59-ad15-476b-b299-a4e1d8639270 req-e4c1def6-2c50-4b71-aee8-b9719d550498 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:27.555006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-75bfff59-ad15-476b-b299-a4e1d8639270 req-e4c1def6-2c50-4b71-aee8-b9719d550498 service nova] Creating event network-changed:acee8f33-cfa6-4297-bcd4-5a348de1fe92 for instance fb680b25-924b-466f-bdbf-296cb1945f93 on hv-cinder-84067 Jun 21 16:02:27.559967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-75bfff59-ad15-476b-b299-a4e1d8639270 req-e4c1def6-2c50-4b71-aee8-b9719d550498 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031759 Jun 21 16:02:27.560564 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 425/866] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:27.874035 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-91b968ed-bd68-46fd-8be9-f991a414421a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:27.874628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-91b968ed-bd68-46fd-8be9-f991a414421a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:27.881936 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91b968ed-bd68-46fd-8be9-f991a414421a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:27.882740 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91b968ed-bd68-46fd-8be9-f991a414421a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:27.883888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91b968ed-bd68-46fd-8be9-f991a414421a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:27.884327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91b968ed-bd68-46fd-8be9-f991a414421a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:28.022775 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-91b968ed-bd68-46fd-8be9-f991a414421a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:28.030744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-91b968ed-bd68-46fd-8be9-f991a414421a tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1690 microversion: 2.1 time: 0.160690 Jun 21 16:02:28.031352 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 442/867] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:27 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:29.054422 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bda1fc3c-0be5-4209-bbb7-a5ffd141a51f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:29.055453 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bda1fc3c-0be5-4209-bbb7-a5ffd141a51f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:29.065422 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bda1fc3c-0be5-4209-bbb7-a5ffd141a51f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:29.066198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bda1fc3c-0be5-4209-bbb7-a5ffd141a51f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:29.067339 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bda1fc3c-0be5-4209-bbb7-a5ffd141a51f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:29.068443 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bda1fc3c-0be5-4209-bbb7-a5ffd141a51f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:29.231943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-bda1fc3c-0be5-4209-bbb7-a5ffd141a51f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:29.240536 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bda1fc3c-0be5-4209-bbb7-a5ffd141a51f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1690 microversion: 2.1 time: 0.194162 Jun 21 16:02:29.241435 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 426/868] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:29 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:30.258590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1b396404-19d2-4a7c-aa30-f1bdcd8448b5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:30.259170 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1b396404-19d2-4a7c-aa30-f1bdcd8448b5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:30.266082 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1b396404-19d2-4a7c-aa30-f1bdcd8448b5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:30.266524 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1b396404-19d2-4a7c-aa30-f1bdcd8448b5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:30.267281 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1b396404-19d2-4a7c-aa30-f1bdcd8448b5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:30.267709 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1b396404-19d2-4a7c-aa30-f1bdcd8448b5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:30.498908 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1b396404-19d2-4a7c-aa30-f1bdcd8448b5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:30.507186 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1b396404-19d2-4a7c-aa30-f1bdcd8448b5 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1690 microversion: 2.1 time: 0.252574 Jun 21 16:02:30.507768 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 443/869] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:30 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1690 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:30.861110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1272101593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-877953109", "security_groups": [{"name": "tempest-secgroup-smoke-930699362"}], "block_device_mapping_v2": [{"uuid": "f20bb2cc-6f67-4c6b-b5fc-739f80ed0beb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "394d887b-9dbe-47a5-a600-3a263ed9e0b8"}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:31.009607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] validate_networks() for [('394d887b-9dbe-47a5-a600-3a263ed9e0b8', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:02:31.512939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-0089e70e-d36e-4b7f-b1b2-589ff533498b req-75625904-422c-46fd-9454-0786440dd9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5afaf8-702b-44ef-bafd-b80903345966", "name": "network-vif-deleted", "tag": "d74a9552-5153-4ad9-8130-43325526cc8b"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:31.526549 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0089e70e-d36e-4b7f-b1b2-589ff533498b req-75625904-422c-46fd-9454-0786440dd9c3 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:31.527144 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-0089e70e-d36e-4b7f-b1b2-589ff533498b req-75625904-422c-46fd-9454-0786440dd9c3 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:31.552750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-0089e70e-d36e-4b7f-b1b2-589ff533498b req-75625904-422c-46fd-9454-0786440dd9c3 service nova] Creating event network-vif-deleted:d74a9552-5153-4ad9-8130-43325526cc8b for instance db5afaf8-702b-44ef-bafd-b80903345966 on hv-cinder-84067 Jun 21 16:02:31.558459 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-0089e70e-d36e-4b7f-b1b2-589ff533498b req-75625904-422c-46fd-9454-0786440dd9c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048960 Jun 21 16:02:31.559376 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 444/870] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:02:31.565423 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2cc2e790-11c4-48f6-828d-ff3ac44932e8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:31.566416 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2cc2e790-11c4-48f6-828d-ff3ac44932e8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:31.575481 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2cc2e790-11c4-48f6-828d-ff3ac44932e8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:31.575973 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2cc2e790-11c4-48f6-828d-ff3ac44932e8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:31.576951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2cc2e790-11c4-48f6-828d-ff3ac44932e8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:31.577699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2cc2e790-11c4-48f6-828d-ff3ac44932e8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:31.665714 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2cc2e790-11c4-48f6-828d-ff3ac44932e8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:31.674478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:31.679122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2cc2e790-11c4-48f6-828d-ff3ac44932e8 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 200 len: 1330 microversion: 2.1 time: 0.118336 Jun 21 16:02:31.681246 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 445/871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:31 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 1330 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:31.685051 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:02:31.685462 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:02:31.685967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:02:31.686363 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:02:31.687394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:02:31.697033 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:31.697469 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:31.698320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:31.698741 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:31.715843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Getting quotas for project 658a35680c70498db2bccc1085c22b21. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:02:31.720044 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Getting quotas for user 0943474b3d4d49d7973619388dab2be1 and project 658a35680c70498db2bccc1085c22b21. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:02:31.783712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:02:31.786354 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f20bb2cc-6f67-4c6b-b5fc-739f80ed0beb',volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:02:31.927885 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7a800536-2efd-4e06-a6c0-9b9935ec8060 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.070244 Jun 21 16:02:31.928811 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 427/872] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:02:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:02:31.938919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-bee83aa1-fa87-43ee-a9d7-f507d5ee8d73 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:31.940334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-bee83aa1-fa87-43ee-a9d7-f507d5ee8d73 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:32.051229 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bee83aa1-fa87-43ee-a9d7-f507d5ee8d73 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:32.078361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-bee83aa1-fa87-43ee-a9d7-f507d5ee8d73 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1094 microversion: 2.1 time: 0.143463 Jun 21 16:02:32.086339 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 446/873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:31 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1094 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:32.698548 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:32.698907 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: db5afaf8-702b-44ef-bafd-b80903345966] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:32.705765 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:32.706235 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:32.706994 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:32.708928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:32.723193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] HTTP exception thrown: Instance db5afaf8-702b-44ef-bafd-b80903345966 could not be found. Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Request method failure captured: Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 HTTP/1.1 Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiseoMRZ-FyFa7yln6vEQlzo7lNXs7ArqF6Nvs6bxzqJ6Ojas_BdnGVED-ZosLrOF01Dg-RQtNYXr5b1sKriCfPdGX6ZelPwrEn6hlT8fdUxiZHzr3PnnsiZ40sUlyA2YQWAMoYm0tybTNR-OImRAuw_EbcgDUM_PMxqknDEqxAKLz4M8 Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:02:32.725229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8818885318b54ef6858e754d2bc4587c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 01571ac0b01845f78192269cacb23644 Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance db5afaf8-702b-44ef-bafd-b80903345966 could not be found. Jun 21 16:02:32.727019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'db5afaf8-702b-44ef-bafd-b80903345966'} Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db5afaf8-702b-44ef-bafd-b80903345966 could not be found. Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:02:32.727836 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db5afaf8-702b-44ef-bafd-b80903345966 could not be found. Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db5afaf8-702b-44ef-bafd-b80903345966 could not be found. Jun 21 16:02:32.729456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:32.730946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Returning 404 to user: Instance db5afaf8-702b-44ef-bafd-b80903345966 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:02:32.730946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-40e91183-921e-4c5c-913f-cc6c642eb1bd tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966" status: 404 len: 111 microversion: 2.1 time: 0.032729 Jun 21 16:02:32.730946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 428/874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:32 2022] GET /compute/v2.1/servers/db5afaf8-702b-44ef-bafd-b80903345966 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:02:32.735984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-977a2ff3-f8c0-4d03-b66b-e78d9438fdc9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '.version_select at 0x7f73b5cf8670>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:32.756933 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-977a2ff3-f8c0-4d03-b66b-e78d9438fdc9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053277185" status: 202 len: 0 microversion: 2.1 time: 0.024810 Jun 21 16:02:32.757518 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 447/875] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jun 21 16:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053277185 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:02:33.096775 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-eb9f853d-c905-4da4-9b7f-71f0e122a102 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:33.097458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-eb9f853d-c905-4da4-9b7f-71f0e122a102 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:33.105220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eb9f853d-c905-4da4-9b7f-71f0e122a102 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:33.105921 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eb9f853d-c905-4da4-9b7f-71f0e122a102 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:33.106829 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eb9f853d-c905-4da4-9b7f-71f0e122a102 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:33.107399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-eb9f853d-c905-4da4-9b7f-71f0e122a102 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:33.130814 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:33.192040 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-eb9f853d-c905-4da4-9b7f-71f0e122a102 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:33.201544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-eb9f853d-c905-4da4-9b7f-71f0e122a102 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1210 microversion: 2.1 time: 0.109174 Jun 21 16:02:33.202143 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 429/876] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:33 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:34.219476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-21275682-65a8-417a-8683-a8dcc4cc87dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:34.220824 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-21275682-65a8-417a-8683-a8dcc4cc87dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:34.229486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-21275682-65a8-417a-8683-a8dcc4cc87dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:34.229761 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-21275682-65a8-417a-8683-a8dcc4cc87dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:34.230913 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-21275682-65a8-417a-8683-a8dcc4cc87dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:34.231344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-21275682-65a8-417a-8683-a8dcc4cc87dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:34.449310 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-21275682-65a8-417a-8683-a8dcc4cc87dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:34.460097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-21275682-65a8-417a-8683-a8dcc4cc87dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.245064 Jun 21 16:02:34.460988 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 448/877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:34 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:34.508986 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-907f9b2e-7b0f-468e-89f9-b80f608ba9cb req-059796d3-1c70-4adc-a835-272bc1410143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb343e0-4cd2-4d5e-96e7-3118e40b27d9", "tag": "9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:34.521881 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-907f9b2e-7b0f-468e-89f9-b80f608ba9cb req-059796d3-1c70-4adc-a835-272bc1410143 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:34.522620 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-907f9b2e-7b0f-468e-89f9-b80f608ba9cb req-059796d3-1c70-4adc-a835-272bc1410143 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:34.535307 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-907f9b2e-7b0f-468e-89f9-b80f608ba9cb req-059796d3-1c70-4adc-a835-272bc1410143 service nova] Creating event network-changed:9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe for instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 on hv-cinder-84067 Jun 21 16:02:34.541562 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-907f9b2e-7b0f-468e-89f9-b80f608ba9cb req-059796d3-1c70-4adc-a835-272bc1410143 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037234 Jun 21 16:02:34.542314 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 430/878] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:35.476959 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-bce4c5b7-5238-4b14-8edf-57429efcabfc tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:35.477573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-bce4c5b7-5238-4b14-8edf-57429efcabfc tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:35.484716 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bce4c5b7-5238-4b14-8edf-57429efcabfc tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:35.485165 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bce4c5b7-5238-4b14-8edf-57429efcabfc tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:35.485957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bce4c5b7-5238-4b14-8edf-57429efcabfc tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:35.486401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bce4c5b7-5238-4b14-8edf-57429efcabfc tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:35.629142 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bce4c5b7-5238-4b14-8edf-57429efcabfc tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:35.638060 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-bce4c5b7-5238-4b14-8edf-57429efcabfc tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.165080 Jun 21 16:02:35.638600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 449/879] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:35 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:35.740627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a78fac1e-75ae-4288-9361-8da629292239 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:35.741207 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a78fac1e-75ae-4288-9361-8da629292239 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:35.743259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:35.749171 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a78fac1e-75ae-4288-9361-8da629292239 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:35.749655 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a78fac1e-75ae-4288-9361-8da629292239 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:35.750457 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a78fac1e-75ae-4288-9361-8da629292239 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:35.750903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a78fac1e-75ae-4288-9361-8da629292239 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:35.777365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a78fac1e-75ae-4288-9361-8da629292239 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:02:35.867757 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a78fac1e-75ae-4288-9361-8da629292239 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 204 len: 0 microversion: 2.1 time: 0.131504 Jun 21 16:02:35.868347 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 431/880] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:02:35 2022] DELETE /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:02:35.876970 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1ad88398-0ff4-4747-a655-99f238fd0375 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:35.877574 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1ad88398-0ff4-4747-a655-99f238fd0375 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:35.885447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ad88398-0ff4-4747-a655-99f238fd0375 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:35.885916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ad88398-0ff4-4747-a655-99f238fd0375 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:35.886671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ad88398-0ff4-4747-a655-99f238fd0375 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:35.887095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ad88398-0ff4-4747-a655-99f238fd0375 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:36.027340 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1ad88398-0ff4-4747-a655-99f238fd0375 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:36.035488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1ad88398-0ff4-4747-a655-99f238fd0375 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1508 microversion: 2.1 time: 0.162859 Jun 21 16:02:36.036112 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 450/881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:35 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:36.659754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3c101317-0e5e-426f-94b8-d8e118e8f25b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:36.660570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3c101317-0e5e-426f-94b8-d8e118e8f25b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:36.667776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3c101317-0e5e-426f-94b8-d8e118e8f25b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:36.668220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3c101317-0e5e-426f-94b8-d8e118e8f25b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:36.668974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3c101317-0e5e-426f-94b8-d8e118e8f25b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:36.669400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3c101317-0e5e-426f-94b8-d8e118e8f25b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:36.812734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3c101317-0e5e-426f-94b8-d8e118e8f25b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:36.824145 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3c101317-0e5e-426f-94b8-d8e118e8f25b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.171211 Jun 21 16:02:36.824859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 432/882] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:36 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:37.055393 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6c7500aa-581b-43eb-94f9-4476f47ced4b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:37.055993 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6c7500aa-581b-43eb-94f9-4476f47ced4b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:37.059762 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:37.064197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6c7500aa-581b-43eb-94f9-4476f47ced4b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:37.064642 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6c7500aa-581b-43eb-94f9-4476f47ced4b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:37.065401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6c7500aa-581b-43eb-94f9-4476f47ced4b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:37.065872 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6c7500aa-581b-43eb-94f9-4476f47ced4b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:37.219950 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6c7500aa-581b-43eb-94f9-4476f47ced4b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:37.228274 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6c7500aa-581b-43eb-94f9-4476f47ced4b tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1508 microversion: 2.1 time: 0.177305 Jun 21 16:02:37.228847 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 451/883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:37 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:37.845523 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5317c5f6-6b71-4487-8caf-212dbe5389f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:37.846272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5317c5f6-6b71-4487-8caf-212dbe5389f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:37.854892 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5317c5f6-6b71-4487-8caf-212dbe5389f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:37.855334 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5317c5f6-6b71-4487-8caf-212dbe5389f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:37.856091 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5317c5f6-6b71-4487-8caf-212dbe5389f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:37.856516 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5317c5f6-6b71-4487-8caf-212dbe5389f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:38.024076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5317c5f6-6b71-4487-8caf-212dbe5389f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:38.036146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5317c5f6-6b71-4487-8caf-212dbe5389f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.196696 Jun 21 16:02:38.037066 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 433/884] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:37 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:38.244727 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dddf0e42-f85e-4e20-92ba-c44c0a0383f2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:38.246007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dddf0e42-f85e-4e20-92ba-c44c0a0383f2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:38.252800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dddf0e42-f85e-4e20-92ba-c44c0a0383f2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:38.253241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dddf0e42-f85e-4e20-92ba-c44c0a0383f2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:38.254031 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dddf0e42-f85e-4e20-92ba-c44c0a0383f2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:38.254495 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dddf0e42-f85e-4e20-92ba-c44c0a0383f2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:38.474462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dddf0e42-f85e-4e20-92ba-c44c0a0383f2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:38.483936 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dddf0e42-f85e-4e20-92ba-c44c0a0383f2 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 200 len: 1508 microversion: 2.1 time: 0.242784 Jun 21 16:02:38.484338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 452/885] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:38 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:38.600566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-5ea05295-c4c4-4d31-be0b-c77cfb215aa0 req-837811ae-f027-4ef1-96cb-b669d25d7582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6a0f84-f623-4591-98ec-44888b07337d", "name": "network-vif-deleted", "tag": "1aa4a2b5-b308-481b-a519-cb4e91e3d01c"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:38.608882 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-5ea05295-c4c4-4d31-be0b-c77cfb215aa0 req-837811ae-f027-4ef1-96cb-b669d25d7582 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:38.609293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-5ea05295-c4c4-4d31-be0b-c77cfb215aa0 req-837811ae-f027-4ef1-96cb-b669d25d7582 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:38.621492 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-5ea05295-c4c4-4d31-be0b-c77cfb215aa0 req-837811ae-f027-4ef1-96cb-b669d25d7582 service nova] Creating event network-vif-deleted:1aa4a2b5-b308-481b-a519-cb4e91e3d01c for instance ef6a0f84-f623-4591-98ec-44888b07337d on hv-cinder-84067 Jun 21 16:02:38.627041 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-5ea05295-c4c4-4d31-be0b-c77cfb215aa0 req-837811ae-f027-4ef1-96cb-b669d25d7582 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030424 Jun 21 16:02:38.627822 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 434/886] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:39.054240 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b883a44e-5ca4-4b28-b720-ca45335eb7f1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:39.054958 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b883a44e-5ca4-4b28-b720-ca45335eb7f1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:39.061991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b883a44e-5ca4-4b28-b720-ca45335eb7f1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:39.062499 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b883a44e-5ca4-4b28-b720-ca45335eb7f1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:39.063265 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b883a44e-5ca4-4b28-b720-ca45335eb7f1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:39.063688 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b883a44e-5ca4-4b28-b720-ca45335eb7f1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:39.202835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b883a44e-5ca4-4b28-b720-ca45335eb7f1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:39.210945 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b883a44e-5ca4-4b28-b720-ca45335eb7f1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.161113 Jun 21 16:02:39.211513 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 453/887] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:39 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:39.505131 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:39.505853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: ef6a0f84-f623-4591-98ec-44888b07337d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:39.512545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:39.512984 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:39.513740 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:39.514201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:39.528484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] HTTP exception thrown: Instance ef6a0f84-f623-4591-98ec-44888b07337d could not be found. Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Request method failure captured: Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d HTTP/1.1 Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiseoMRZ-FyFa7yln6vEQlzo7lNXs7ArqF6Nvs6bxzqJ6Ojas_BdnGVED-ZosLrOF01Dg-RQtNYXr5b1sKriCfPdGX6ZelPwrEn6hlT8fdUxiZHzr3PnnsiZ40sUlyA2YQWAMoYm0tybTNR-OImRAuw_EbcgDUM_PMxqknDEqxAKLz4M8 Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:02:39.530142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8818885318b54ef6858e754d2bc4587c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 01571ac0b01845f78192269cacb23644 Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance ef6a0f84-f623-4591-98ec-44888b07337d could not be found. Jun 21 16:02:39.531596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'ef6a0f84-f623-4591-98ec-44888b07337d'} Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6a0f84-f623-4591-98ec-44888b07337d could not be found. Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:02:39.532480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6a0f84-f623-4591-98ec-44888b07337d could not be found. Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6a0f84-f623-4591-98ec-44888b07337d could not be found. Jun 21 16:02:39.533924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:39.535262 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Returning 404 to user: Instance ef6a0f84-f623-4591-98ec-44888b07337d could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:02:39.535262 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-06888e35-9272-4acd-8a8a-115fee372733 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d" status: 404 len: 111 microversion: 2.1 time: 0.034016 Jun 21 16:02:39.535449 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 435/888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:39 2022] GET /compute/v2.1/servers/ef6a0f84-f623-4591-98ec-44888b07337d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:02:39.540906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8f48404f-ac2d-467f-91a3-ba1065653b2f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:39.541410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8f48404f-ac2d-467f-91a3-ba1065653b2f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:39.548374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8f48404f-ac2d-467f-91a3-ba1065653b2f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:39.548815 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8f48404f-ac2d-467f-91a3-ba1065653b2f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:39.549565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8f48404f-ac2d-467f-91a3-ba1065653b2f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:39.550032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8f48404f-ac2d-467f-91a3-ba1065653b2f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:39.582755 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8f48404f-ac2d-467f-91a3-ba1065653b2f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:02:39.674724 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8f48404f-ac2d-467f-91a3-ba1065653b2f tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 204 len: 0 microversion: 2.1 time: 0.137546 Jun 21 16:02:39.675545 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 454/889] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:02:39 2022] DELETE /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:02:39.684616 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-68138a27-7c5c-41be-973b-4891039ee8f9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:39.685280 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-68138a27-7c5c-41be-973b-4891039ee8f9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:39.691686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-68138a27-7c5c-41be-973b-4891039ee8f9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:39.692202 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-68138a27-7c5c-41be-973b-4891039ee8f9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:39.692962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-68138a27-7c5c-41be-973b-4891039ee8f9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:39.693685 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-68138a27-7c5c-41be-973b-4891039ee8f9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:39.845385 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-68138a27-7c5c-41be-973b-4891039ee8f9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:39.853211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-68138a27-7c5c-41be-973b-4891039ee8f9 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.173261 Jun 21 16:02:39.853804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 436/890] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:39 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:40.228975 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-970c836b-18c4-4b0a-b85f-9cc3dabc6403 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:40.229669 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-970c836b-18c4-4b0a-b85f-9cc3dabc6403 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:40.236383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-970c836b-18c4-4b0a-b85f-9cc3dabc6403 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:40.236832 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-970c836b-18c4-4b0a-b85f-9cc3dabc6403 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:40.237605 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-970c836b-18c4-4b0a-b85f-9cc3dabc6403 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:40.238169 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-970c836b-18c4-4b0a-b85f-9cc3dabc6403 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:40.375008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-970c836b-18c4-4b0a-b85f-9cc3dabc6403 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:40.383208 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-970c836b-18c4-4b0a-b85f-9cc3dabc6403 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.158826 Jun 21 16:02:40.383769 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 455/891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:40 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:40.871038 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e30cca89-32b8-42ff-a228-eba529e7bb01 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:40.871645 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e30cca89-32b8-42ff-a228-eba529e7bb01 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:40.878942 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e30cca89-32b8-42ff-a228-eba529e7bb01 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:40.879497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e30cca89-32b8-42ff-a228-eba529e7bb01 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:40.880464 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e30cca89-32b8-42ff-a228-eba529e7bb01 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:40.880898 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e30cca89-32b8-42ff-a228-eba529e7bb01 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:41.021373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e30cca89-32b8-42ff-a228-eba529e7bb01 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:41.029550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e30cca89-32b8-42ff-a228-eba529e7bb01 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.162376 Jun 21 16:02:41.030358 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 437/892] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:40 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:41.400720 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-68349307-5f1a-4446-b05a-6fde4f2cf23f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:41.401318 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-68349307-5f1a-4446-b05a-6fde4f2cf23f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:41.408026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-68349307-5f1a-4446-b05a-6fde4f2cf23f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:41.408504 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-68349307-5f1a-4446-b05a-6fde4f2cf23f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:41.409222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-68349307-5f1a-4446-b05a-6fde4f2cf23f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:41.409689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-68349307-5f1a-4446-b05a-6fde4f2cf23f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:41.551979 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-68349307-5f1a-4446-b05a-6fde4f2cf23f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:41.561584 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-68349307-5f1a-4446-b05a-6fde4f2cf23f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.164744 Jun 21 16:02:41.562532 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 456/893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:41 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:42.047127 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-05d09d2f-bb50-4e7f-953f-c27a2208464e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:42.047127 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-05d09d2f-bb50-4e7f-953f-c27a2208464e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:42.053049 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:42.053692 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=6 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:42.056560 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-05d09d2f-bb50-4e7f-953f-c27a2208464e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:42.057162 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-05d09d2f-bb50-4e7f-953f-c27a2208464e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:42.058036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-05d09d2f-bb50-4e7f-953f-c27a2208464e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:42.059301 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-05d09d2f-bb50-4e7f-953f-c27a2208464e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:42.205365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-05d09d2f-bb50-4e7f-953f-c27a2208464e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:42.213880 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-05d09d2f-bb50-4e7f-953f-c27a2208464e tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1523 microversion: 2.1 time: 0.171148 Jun 21 16:02:42.214938 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 438/894] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:42 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:42.578983 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b02c6849-a70f-4d70-8cd7-41d34e2f3b9c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:42.580435 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b02c6849-a70f-4d70-8cd7-41d34e2f3b9c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:42.583039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:42.589144 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b02c6849-a70f-4d70-8cd7-41d34e2f3b9c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:42.589611 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b02c6849-a70f-4d70-8cd7-41d34e2f3b9c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:42.590405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b02c6849-a70f-4d70-8cd7-41d34e2f3b9c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:42.590835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b02c6849-a70f-4d70-8cd7-41d34e2f3b9c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:42.734091 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b02c6849-a70f-4d70-8cd7-41d34e2f3b9c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:42.745039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b02c6849-a70f-4d70-8cd7-41d34e2f3b9c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.170084 Jun 21 16:02:42.745629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 457/895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:42 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:42.790517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-c091f708-9c6f-484a-a149-455e39eb2f6d req-23e541df-f1fe-46de-a769-ef81ab08ce62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81775f43-85e6-49c7-9f5c-adeff449bb59", "name": "network-vif-deleted", "tag": "d386ad21-9f3a-498f-a971-ba7627c4e5a1"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:42.803990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-c091f708-9c6f-484a-a149-455e39eb2f6d req-23e541df-f1fe-46de-a769-ef81ab08ce62 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:42.804426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-c091f708-9c6f-484a-a149-455e39eb2f6d req-23e541df-f1fe-46de-a769-ef81ab08ce62 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:42.818648 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-c091f708-9c6f-484a-a149-455e39eb2f6d req-23e541df-f1fe-46de-a769-ef81ab08ce62 service nova] Creating event network-vif-deleted:d386ad21-9f3a-498f-a971-ba7627c4e5a1 for instance 81775f43-85e6-49c7-9f5c-adeff449bb59 on hv-cinder-84067 Jun 21 16:02:42.825504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-c091f708-9c6f-484a-a149-455e39eb2f6d req-23e541df-f1fe-46de-a769-ef81ab08ce62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042763 Jun 21 16:02:42.826143 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 439/896] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:43.132317 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-894b3d9f-e607-4ee7-bb09-d77a4d149a61 req-14a22e8d-4593-470c-93a1-017f0b163e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb343e0-4cd2-4d5e-96e7-3118e40b27d9", "name": "network-vif-plugged", "status": "completed", "tag": "9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:43.141552 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-894b3d9f-e607-4ee7-bb09-d77a4d149a61 req-14a22e8d-4593-470c-93a1-017f0b163e7e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:43.142098 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-894b3d9f-e607-4ee7-bb09-d77a4d149a61 req-14a22e8d-4593-470c-93a1-017f0b163e7e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:43.155404 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-894b3d9f-e607-4ee7-bb09-d77a4d149a61 req-14a22e8d-4593-470c-93a1-017f0b163e7e service nova] Creating event network-vif-plugged:9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe for instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 on hv-cinder-84067 Jun 21 16:02:43.171257 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-894b3d9f-e607-4ee7-bb09-d77a4d149a61 req-14a22e8d-4593-470c-93a1-017f0b163e7e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043057 Jun 21 16:02:43.172470 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 458/897] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:43.231436 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:43.232344 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:43.240287 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:43.240738 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:43.241522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:43.241974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:43.276032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:43.277744 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:43.278961 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lazy-loading 'fault' on Instance uuid 81775f43-85e6-49c7-9f5c-adeff449bb59 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:02:43.327964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01571ac0b01845f78192269cacb23644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8818885318b54ef6858e754d2bc4587c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:43.342304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-29b20f85-86e0-4788-86db-9377345bb241 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 200 len: 1312 microversion: 2.1 time: 0.115185 Jun 21 16:02:43.342933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 440/898] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:43 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:43.763541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fa7dc4b7-c3c8-4814-b805-cad93fcdf18d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:43.764232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fa7dc4b7-c3c8-4814-b805-cad93fcdf18d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:43.771306 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa7dc4b7-c3c8-4814-b805-cad93fcdf18d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:43.771750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa7dc4b7-c3c8-4814-b805-cad93fcdf18d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:43.772763 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa7dc4b7-c3c8-4814-b805-cad93fcdf18d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:43.773230 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fa7dc4b7-c3c8-4814-b805-cad93fcdf18d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:43.910901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fa7dc4b7-c3c8-4814-b805-cad93fcdf18d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:43.919106 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fa7dc4b7-c3c8-4814-b805-cad93fcdf18d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.160593 Jun 21 16:02:43.919671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 459/899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:43 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:44.362224 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:44.363144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] [instance: 81775f43-85e6-49c7-9f5c-adeff449bb59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:44.370327 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:44.370768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:44.371533 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:44.371960 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:44.386189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] HTTP exception thrown: Instance 81775f43-85e6-49c7-9f5c-adeff449bb59 could not be found. Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Request method failure captured: Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 HTTP/1.1 Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiseoMRZ-FyFa7yln6vEQlzo7lNXs7ArqF6Nvs6bxzqJ6Ojas_BdnGVED-ZosLrOF01Dg-RQtNYXr5b1sKriCfPdGX6ZelPwrEn6hlT8fdUxiZHzr3PnnsiZ40sUlyA2YQWAMoYm0tybTNR-OImRAuw_EbcgDUM_PMxqknDEqxAKLz4M8 Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:02:44.387851 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8818885318b54ef6858e754d2bc4587c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8818885318b54ef6858e754d2bc4587c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 8818885318b54ef6858e754d2bc4587c Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-746209808 Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 01571ac0b01845f78192269cacb23644 Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-746209808-project Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 81775f43-85e6-49c7-9f5c-adeff449bb59 could not be found. Jun 21 16:02:44.389151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '81775f43-85e6-49c7-9f5c-adeff449bb59'} Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81775f43-85e6-49c7-9f5c-adeff449bb59 could not be found. Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:02:44.389948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81775f43-85e6-49c7-9f5c-adeff449bb59 could not be found. Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81775f43-85e6-49c7-9f5c-adeff449bb59 could not be found. Jun 21 16:02:44.391349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:02:44.392632 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] Returning 404 to user: Instance 81775f43-85e6-49c7-9f5c-adeff449bb59 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:02:44.392632 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dc96b86c-9480-4b15-a42f-c04a97354a15 tempest-ServerRescueNegativeTestJSON-746209808 tempest-ServerRescueNegativeTestJSON-746209808-project] 10.222.0.52 "GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59" status: 404 len: 111 microversion: 2.1 time: 0.032143 Jun 21 16:02:44.392632 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 441/900] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:44 2022] GET /compute/v2.1/servers/81775f43-85e6-49c7-9f5c-adeff449bb59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:02:44.938169 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c1d62619-a470-49c8-ba7a-030d5d46d7d1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:44.939032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c1d62619-a470-49c8-ba7a-030d5d46d7d1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:44.947037 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c1d62619-a470-49c8-ba7a-030d5d46d7d1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:44.947496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c1d62619-a470-49c8-ba7a-030d5d46d7d1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:44.948366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c1d62619-a470-49c8-ba7a-030d5d46d7d1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:44.948809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c1d62619-a470-49c8-ba7a-030d5d46d7d1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:45.092196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c1d62619-a470-49c8-ba7a-030d5d46d7d1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:45.100869 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c1d62619-a470-49c8-ba7a-030d5d46d7d1 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1265 microversion: 2.1 time: 0.168561 Jun 21 16:02:45.101430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 460/901] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:44 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:46.118006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-364d9c64-6442-4e50-af59-c924ef62e995 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:46.118610 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-364d9c64-6442-4e50-af59-c924ef62e995 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:46.126312 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-364d9c64-6442-4e50-af59-c924ef62e995 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:46.126760 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-364d9c64-6442-4e50-af59-c924ef62e995 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:46.127532 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-364d9c64-6442-4e50-af59-c924ef62e995 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:46.127966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-364d9c64-6442-4e50-af59-c924ef62e995 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:46.267345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-364d9c64-6442-4e50-af59-c924ef62e995 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:46.276172 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-364d9c64-6442-4e50-af59-c924ef62e995 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1452 microversion: 2.1 time: 0.162156 Jun 21 16:02:46.276884 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 442/902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:46 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:46.293585 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a83c85b4-2cc9-4abe-b5c1-4a983a604498 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:46.294855 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a83c85b4-2cc9-4abe-b5c1-4a983a604498 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:46.301944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a83c85b4-2cc9-4abe-b5c1-4a983a604498 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:46.302415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a83c85b4-2cc9-4abe-b5c1-4a983a604498 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:46.303204 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a83c85b4-2cc9-4abe-b5c1-4a983a604498 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:46.303629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a83c85b4-2cc9-4abe-b5c1-4a983a604498 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:46.446540 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a83c85b4-2cc9-4abe-b5c1-4a983a604498 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:46.457792 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a83c85b4-2cc9-4abe-b5c1-4a983a604498 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1452 microversion: 2.1 time: 0.167979 Jun 21 16:02:46.458852 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 461/903] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:02:46 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:48.455112 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-7a5c87b9-71fe-4fd9-a20f-88658212830b req-e49925ec-dae0-41b6-a0a4-0930c45710cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb343e0-4cd2-4d5e-96e7-3118e40b27d9", "tag": "9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:48.464120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-7a5c87b9-71fe-4fd9-a20f-88658212830b req-e49925ec-dae0-41b6-a0a4-0930c45710cd service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:48.464841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-7a5c87b9-71fe-4fd9-a20f-88658212830b req-e49925ec-dae0-41b6-a0a4-0930c45710cd service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:48.478452 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-7a5c87b9-71fe-4fd9-a20f-88658212830b req-e49925ec-dae0-41b6-a0a4-0930c45710cd service nova] Creating event network-changed:9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe for instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 on hv-cinder-84067 Jun 21 16:02:48.483819 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-7a5c87b9-71fe-4fd9-a20f-88658212830b req-e49925ec-dae0-41b6-a0a4-0930c45710cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032228 Jun 21 16:02:48.484404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 443/904] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:50.666542 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-607f5748-0c3e-4e38-875d-52cc6cc0d3c1 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5d4f820>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:50.724276 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-607f5748-0c3e-4e38-875d-52cc6cc0d3c1 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/33d63ee1-57ec-4a7b-a42e-a2f9918893fa" status: 200 len: 350 microversion: 2.1 time: 0.064320 Jun 21 16:02:50.725026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 462/905] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 16:02:50 2022] GET /compute/v2.1/os-volumes/33d63ee1-57ec-4a7b-a42e-a2f9918893fa => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:52.072574 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-167d2bf4-14fa-4296-8a23-26b3bb7d7227 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5dcd0d0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:52.120772 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-167d2bf4-14fa-4296-8a23-26b3bb7d7227 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/df19a2f6-13a3-449e-929d-ac5d92193cf2" status: 200 len: 351 microversion: 2.1 time: 0.053513 Jun 21 16:02:52.121335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 444/906] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 16:02:52 2022] GET /compute/v2.1/os-volumes/df19a2f6-13a3-449e-929d-ac5d92193cf2 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:52.628071 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-da76706d-6c3b-431c-bb4c-607b599fb898 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:52.628626 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-da76706d-6c3b-431c-bb4c-607b599fb898 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:52.635389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-da76706d-6c3b-431c-bb4c-607b599fb898 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:52.635801 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-da76706d-6c3b-431c-bb4c-607b599fb898 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:52.636560 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-da76706d-6c3b-431c-bb4c-607b599fb898 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:52.637002 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-da76706d-6c3b-431c-bb4c-607b599fb898 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:52.663209 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-da76706d-6c3b-431c-bb4c-607b599fb898 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/ips" status: 200 len: 151 microversion: 2.20 time: 0.039811 Jun 21 16:02:52.664137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 463/907] 10.222.0.52 () {60 vars in 1288 bytes} [Tue Jun 21 16:02:52 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:02:53.495863 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dbd0c47b-2322-41ee-a72c-12e0e342ea32 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5cd6700>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:53.545072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dbd0c47b-2322-41ee-a72c-12e0e342ea32 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/9d9c53e0-a1f5-4992-9615-d0213972d3a0" status: 200 len: 351 microversion: 2.1 time: 0.053434 Jun 21 16:02:53.545633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 445/908] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 16:02:53 2022] GET /compute/v2.1/os-volumes/9d9c53e0-a1f5-4992-9615-d0213972d3a0 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:53.557299 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a03b4324-24a4-4f93-a40f-04419b53c674 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5e61e50>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:53.645193 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a03b4324-24a4-4f93-a40f-04419b53c674 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091545 Jun 21 16:02:53.646629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 464/909] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Jun 21 16:02:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:53.660870 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4faa351e-584d-4171-a7b8-f553529b0140 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5c61430>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:53.746643 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4faa351e-584d-4171-a7b8-f553529b0140 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090765 Jun 21 16:02:53.747435 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 446/910] 10.222.0.52 () {58 vars in 1148 bytes} [Tue Jun 21 16:02:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:53.759772 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c52c4403-850e-4dac-a0e9-0ad83c014dfd tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5ccdc10>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:53.844998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c52c4403-850e-4dac-a0e9-0ad83c014dfd tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089151 Jun 21 16:02:53.845930 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 465/911] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Jun 21 16:02:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:53.858891 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3ba42389-fa0b-46c8-a786-b3caf2d3e64b tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5e18e50>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:53.944290 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3ba42389-fa0b-46c8-a786-b3caf2d3e64b tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088977 Jun 21 16:02:53.944832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 447/912] 10.222.0.52 () {58 vars in 1166 bytes} [Tue Jun 21 16:02:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:53.956290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-eaa95139-4a02-4799-b5a7-9073c5921b9e tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5d2cb80>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:54.046031 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-eaa95139-4a02-4799-b5a7-9073c5921b9e tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093352 Jun 21 16:02:54.046600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 466/913] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Jun 21 16:02:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:54.059919 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-913d70d9-63e8-46f1-ad02-14e97b950824 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5e38790>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:54.147771 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-913d70d9-63e8-46f1-ad02-14e97b950824 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092077 Jun 21 16:02:54.148242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 448/914] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Jun 21 16:02:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:54.163962 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d29db6bc-f875-400e-9d1d-ac298c806e15 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5db6ca0>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:54.250410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d29db6bc-f875-400e-9d1d-ac298c806e15 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091775 Jun 21 16:02:54.251221 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 467/915] 10.222.0.52 () {58 vars in 1187 bytes} [Tue Jun 21 16:02:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:02:54.268045 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-57323abb-0d7f-4211-a0a6-8a7e19a9ce93 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] Calling method '.version_select at 0x7f73b5c61a60>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:54.358634 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-57323abb-0d7f-4211-a0a6-8a7e19a9ce93 tempest-VolumesTestJSON-417537603 tempest-VolumesTestJSON-417537603-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.096491 Jun 21 16:02:54.359270 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 449/916] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Jun 21 16:02:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:02:54.552359 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-35cab4a7-6368-45c2-af01-bac08e16a9b0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:02:54.552574 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-35cab4a7-6368-45c2-af01-bac08e16a9b0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:54.561756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35cab4a7-6368-45c2-af01-bac08e16a9b0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:54.562270 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35cab4a7-6368-45c2-af01-bac08e16a9b0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:54.563057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35cab4a7-6368-45c2-af01-bac08e16a9b0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:54.563491 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35cab4a7-6368-45c2-af01-bac08e16a9b0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:54.587697 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-35cab4a7-6368-45c2-af01-bac08e16a9b0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lazy-loading 'flavor' on Instance uuid 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:02:54.591406 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:54.869286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-35cab4a7-6368-45c2-af01-bac08e16a9b0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/action" status: 202 len: 0 microversion: 2.20 time: 0.321109 Jun 21 16:02:54.870488 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 468/917] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jun 21 16:02:54 2022] POST /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:02:54.879204 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:54.879927 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:54.886432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:54.886936 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:54.887748 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:54.888200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:55.024200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:55.035856 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:55.038388 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:55.040141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5446e6f6-6db7-4f63-82a1-3b1f33262689 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.165049 Jun 21 16:02:55.040926 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 450/918] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:02:54 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:02:56.066797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:56.067437 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:56.074596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:56.075044 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:56.075806 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:56.076231 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:56.224399 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:56.234005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:56.235555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:56.236768 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e5c10bc0-e8aa-46fc-8efb-5a39892e1672 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.176026 Jun 21 16:02:56.237354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 469/919] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:02:56 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:02:57.256484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:57.257086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:57.263852 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:57.264289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:57.265032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:57.265451 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:57.404370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:57.413206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:57.414720 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:57.415876 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-babae34b-ae19-4d52-a218-1ddb17ca8d43 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.164287 Jun 21 16:02:57.416437 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 451/920] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:02:57 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:02:58.434458 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:58.435280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:58.442466 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:58.442903 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:58.443727 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:58.444153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:58.592217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:58.601096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:58.602683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:58.603973 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-025459b2-1c5b-4e13-bcca-c593d6d4852e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.173587 Jun 21 16:02:58.604558 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 470/921] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:02:58 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:02:59.622121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:02:59.622714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:02:59.629150 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:59.629584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:59.630414 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:02:59.630832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:02:59.764611 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:59.772671 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:59.774220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:02:59.775372 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-068037bb-cb36-47d9-a27d-2d60efccd35d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.157640 Jun 21 16:02:59.775920 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 452/922] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:02:59 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:00.794590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:00.795314 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:00.803771 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:00.804218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:00.805128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:00.805553 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:00.949036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:00.959187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:00.961104 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:00.962458 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-57f8707d-9e78-4d87-846f-568bd82e9b14 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.172120 Jun 21 16:03:00.963009 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 471/923] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:00 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:01.984769 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:01.985358 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:01.992441 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:01.992882 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:01.993639 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:01.994088 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:02.130672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:02.139576 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:02.141153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:02.142395 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-edfce120-7d4d-462c-af6d-7da44559a5bc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.161536 Jun 21 16:03:02.143025 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 453/924] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:01 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:02.746653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-236e9c5d-adf0-4128-b8c8-e94df74c1cfc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:02.747154 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-236e9c5d-adf0-4128-b8c8-e94df74c1cfc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:02.753986 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-236e9c5d-adf0-4128-b8c8-e94df74c1cfc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:02.754438 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-236e9c5d-adf0-4128-b8c8-e94df74c1cfc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:02.755216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-236e9c5d-adf0-4128-b8c8-e94df74c1cfc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:02.755630 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-236e9c5d-adf0-4128-b8c8-e94df74c1cfc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:02.779677 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-236e9c5d-adf0-4128-b8c8-e94df74c1cfc tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/ips" status: 200 len: 150 microversion: 2.1 time: 0.037904 Jun 21 16:03:02.780261 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 472/925] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 16:03:02 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:03.161111 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:03.161734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:03.168924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:03.169346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:03.170154 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:03.170579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:03.173370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:03.310999 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:03.319339 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:03.321208 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:03.322415 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6c6856c9-f534-4907-b6c4-d1217c3564a0 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.165804 Jun 21 16:03:03.333098 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 454/926] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:03 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:04.118918 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b8f22965-b25a-4a00-8781-8ddbd36ffaed tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0024872-d3e0-4314-97d4-3523aa083597"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:04.120037 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b8f22965-b25a-4a00-8781-8ddbd36ffaed tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:04.126902 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b8f22965-b25a-4a00-8781-8ddbd36ffaed tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:04.127352 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b8f22965-b25a-4a00-8781-8ddbd36ffaed tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:04.128115 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b8f22965-b25a-4a00-8781-8ddbd36ffaed tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:04.128547 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b8f22965-b25a-4a00-8781-8ddbd36ffaed tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:04.341289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:04.342180 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:04.348854 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:04.349343 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:04.350243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:04.350680 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:04.407617 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b8f22965-b25a-4a00-8781-8ddbd36ffaed tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292820 Jun 21 16:03:04.408341 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 473/927] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 16:03:04 2022] POST /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:04.501916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:04.510001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:04.511489 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:04.512827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-52b937ad-c3f9-4cf0-8c16-d152096c9724 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.175556 Jun 21 16:03:04.513592 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 455/928] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:04 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:05.532446 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:05.533135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:05.540084 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:05.540530 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:05.541284 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:05.541707 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:05.682992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:05.691649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:05.693161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:05.694392 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8677d4d1-fce8-4444-b8f5-588e09264d78 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.166788 Jun 21 16:03:05.695373 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 474/929] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:05 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:06.717403 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:06.718176 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:06.721933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:06.726588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:06.727009 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:06.728050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:06.728517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:06.871298 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:06.880044 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:06.881566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:06.882862 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7b492265-0cc7-49d4-92b9-6ed10cba4ed3 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1743 microversion: 2.20 time: 0.169813 Jun 21 16:03:06.883718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 456/930] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:06 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:07.901100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:07.901678 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:07.904339 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:07.910684 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:07.911100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:07.911864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:07.912290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:08.114198 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:08.123712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:08.126381 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:08.127584 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0a942099-6ed4-4347-9590-4f6d7ea422d2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1743 microversion: 2.20 time: 0.231040 Jun 21 16:03:08.128247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 475/931] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:07 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1743 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:09.146404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:09.147023 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:09.154257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:09.154696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:09.155426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:09.155911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:09.307895 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:09.318743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:09.320837 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:09.323022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-530cb5f0-5335-4e0e-a1c6-78150abdae85 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1743 microversion: 2.20 time: 0.180948 Jun 21 16:03:09.323592 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 457/932] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:09 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:10.341328 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:10.342081 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:10.348906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:10.349308 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:10.350099 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:10.350527 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:10.484228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:10.492548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:10.494143 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:10.495370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-25f4f1ad-2de5-4cb4-8f99-f8f7298b8070 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1743 microversion: 2.20 time: 0.158649 Jun 21 16:03:10.495877 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 476/933] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:10 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:11.324265 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-1cbf9eb7-513f-4ec1-8098-0e0c0bce7ba6 req-aff017e1-2535-4921-a333-edd21161ef73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cea78e9-1d9b-4b08-bbe5-93fadd09e685", "name": "network-vif-plugged", "status": "completed", "tag": "b76d21d6-4f2c-4f99-a9ef-d06b45b48736"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:11.334783 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-1cbf9eb7-513f-4ec1-8098-0e0c0bce7ba6 req-aff017e1-2535-4921-a333-edd21161ef73 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:11.335278 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-1cbf9eb7-513f-4ec1-8098-0e0c0bce7ba6 req-aff017e1-2535-4921-a333-edd21161ef73 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:11.347530 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-1cbf9eb7-513f-4ec1-8098-0e0c0bce7ba6 req-aff017e1-2535-4921-a333-edd21161ef73 service nova] Creating event network-vif-plugged:b76d21d6-4f2c-4f99-a9ef-d06b45b48736 for instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 on hv-cinder-84067 Jun 21 16:03:11.352808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-1cbf9eb7-513f-4ec1-8098-0e0c0bce7ba6 req-aff017e1-2535-4921-a333-edd21161ef73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033922 Jun 21 16:03:11.353566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 458/934] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:11.514303 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:11.514908 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:11.521690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:11.522170 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:11.522945 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:11.523374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:11.690065 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:11.700018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:11.701645 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:11.703255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1864be7d-bbe1-4ad5-b486-a1479494379f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1743 microversion: 2.20 time: 0.193047 Jun 21 16:03:11.703877 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 477/935] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:11 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:11.949469 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0024872-d3e0-4314-97d4-3523aa083597"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:11.950787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:11.957142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:11.957594 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:11.958383 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:11.958813 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:12.048391 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Invalid volume: volume c0024872-d3e0-4314-97d4-3523aa083597 is already attached to instances: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: POST /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments HTTP/1.1 Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 74 Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:03:12.051364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {"volumeAttachment": {"volumeId": "c0024872-d3e0-4314-97d4-3523aa083597"}} Jun 21 16:03:12.053072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Invalid volume: volume c0024872-d3e0-4314-97d4-3523aa083597 is already attached to instances: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'server_id': '5c4c7c0a-54a2-4047-85b8-13456b2fb6b7', 'body': {'volumeAttachment': {'volumeId': 'c0024872-d3e0-4314-97d4-3523aa083597'}}} Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c0024872-d3e0-4314-97d4-3523aa083597 is already attached to instances: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:03:12.054011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c0024872-d3e0-4314-97d4-3523aa083597 is already attached to instances: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:03:12.055412 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:03:12.056918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:03:12.056918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:03:12.056918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:03:12.056918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c0024872-d3e0-4314-97d4-3523aa083597 is already attached to instances: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 Jun 21 16:03:12.056918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:03:12.056918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 400 to user: Invalid volume: volume c0024872-d3e0-4314-97d4-3523aa083597 is already attached to instances: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:03:12.056918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-782b00b7-2c78-4046-ac57-4e09178456ab tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108912 Jun 21 16:03:12.058447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 459/936] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 16:03:11 2022] POST /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:03:12.119087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7d9e3962-c1d0-4e25-bd0a-223a5236380a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:12.119803 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7d9e3962-c1d0-4e25-bd0a-223a5236380a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:12.126739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7d9e3962-c1d0-4e25-bd0a-223a5236380a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:12.127225 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7d9e3962-c1d0-4e25-bd0a-223a5236380a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:12.128037 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7d9e3962-c1d0-4e25-bd0a-223a5236380a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:12.128471 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7d9e3962-c1d0-4e25-bd0a-223a5236380a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:12.216262 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-7d9e3962-c1d0-4e25-bd0a-223a5236380a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'services' on Instance uuid 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:03:12.293694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7d9e3962-c1d0-4e25-bd0a-223a5236380a tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments/c0024872-d3e0-4314-97d4-3523aa083597" status: 202 len: 0 microversion: 2.1 time: 0.178730 Jun 21 16:03:12.294370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 478/937] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:03:12 2022] DELETE /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments/c0024872-d3e0-4314-97d4-3523aa083597 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:03:12.302874 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d00de49c-2f1c-4594-b8fe-27dd5274b86b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:12.304021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d00de49c-2f1c-4594-b8fe-27dd5274b86b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:12.311434 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d00de49c-2f1c-4594-b8fe-27dd5274b86b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:12.311858 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d00de49c-2f1c-4594-b8fe-27dd5274b86b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:12.312677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d00de49c-2f1c-4594-b8fe-27dd5274b86b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:12.313107 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d00de49c-2f1c-4594-b8fe-27dd5274b86b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:12.344818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d00de49c-2f1c-4594-b8fe-27dd5274b86b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Jun 21 16:03:12.345474 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 460/938] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:03:12 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:12.727217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:12.728174 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:12.737653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:12.738371 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:12.739522 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:12.740146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:12.880115 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:12.889426 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:12.891217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:12.893147 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-06bb7491-89c0-47c9-8829-6dbcf3e416a4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1743 microversion: 2.20 time: 0.173187 Jun 21 16:03:12.894085 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 479/939] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:12 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:13.358452 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b3a78930-c885-45e4-a4db-80609a1ad183 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:13.359411 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b3a78930-c885-45e4-a4db-80609a1ad183 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:13.366399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b3a78930-c885-45e4-a4db-80609a1ad183 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:13.366852 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b3a78930-c885-45e4-a4db-80609a1ad183 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:13.367600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b3a78930-c885-45e4-a4db-80609a1ad183 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:13.368924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b3a78930-c885-45e4-a4db-80609a1ad183 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:13.402987 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b3a78930-c885-45e4-a4db-80609a1ad183 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048507 Jun 21 16:03:13.403541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 461/940] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:03:13 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:13.912462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:13.913063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:13.921816 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:13.922424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:13.923372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:13.923795 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:14.103830 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:14.114751 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:14.116237 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:14.117408 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4e5bfe64-e99d-4937-8936-16ad4ca0da9a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.209225 Jun 21 16:03:14.118012 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 480/941] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:13 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:14.415457 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-30cbc4b0-a16a-4aa2-a65e-7e1f44438154 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:14.417618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-30cbc4b0-a16a-4aa2-a65e-7e1f44438154 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:14.425131 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30cbc4b0-a16a-4aa2-a65e-7e1f44438154 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:14.425867 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30cbc4b0-a16a-4aa2-a65e-7e1f44438154 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:14.426998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30cbc4b0-a16a-4aa2-a65e-7e1f44438154 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:14.427594 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30cbc4b0-a16a-4aa2-a65e-7e1f44438154 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:14.471926 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-30cbc4b0-a16a-4aa2-a65e-7e1f44438154 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061403 Jun 21 16:03:14.472702 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 462/942] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:03:14 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:03:14.543430 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7bcc57c3-98d5-4478-af41-ec54f0b28de6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:14.544841 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7bcc57c3-98d5-4478-af41-ec54f0b28de6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:14.551607 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7bcc57c3-98d5-4478-af41-ec54f0b28de6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:14.552125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7bcc57c3-98d5-4478-af41-ec54f0b28de6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:14.552887 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7bcc57c3-98d5-4478-af41-ec54f0b28de6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:14.553319 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7bcc57c3-98d5-4478-af41-ec54f0b28de6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:14.581006 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7bcc57c3-98d5-4478-af41-ec54f0b28de6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:03:14.584323 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:14.688041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7bcc57c3-98d5-4478-af41-ec54f0b28de6 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 204 len: 0 microversion: 2.1 time: 0.148561 Jun 21 16:03:14.688994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 481/943] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:03:14 2022] DELETE /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:03:14.699957 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9ef68fa6-0542-4e9a-a0ae-d5e42037f53b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:14.700650 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9ef68fa6-0542-4e9a-a0ae-d5e42037f53b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:14.707835 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ef68fa6-0542-4e9a-a0ae-d5e42037f53b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:14.708276 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ef68fa6-0542-4e9a-a0ae-d5e42037f53b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:14.709066 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ef68fa6-0542-4e9a-a0ae-d5e42037f53b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:14.709495 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ef68fa6-0542-4e9a-a0ae-d5e42037f53b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:14.847032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9ef68fa6-0542-4e9a-a0ae-d5e42037f53b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:14.855102 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9ef68fa6-0542-4e9a-a0ae-d5e42037f53b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1681 microversion: 2.1 time: 0.160106 Jun 21 16:03:14.855687 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 463/944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:14 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:03:15.137649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:15.139220 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:15.146241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:15.146953 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:15.147733 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:15.148172 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:15.332953 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:15.352243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:15.354301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:15.357046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7b85cb49-1c53-428f-a5ae-e1968d07ce46 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.224169 Jun 21 16:03:15.358090 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 482/945] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:15 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:15.872827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9735313c-0e13-459d-9dd9-a20b7136e587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:15.873614 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9735313c-0e13-459d-9dd9-a20b7136e587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:15.884036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9735313c-0e13-459d-9dd9-a20b7136e587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:15.885754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9735313c-0e13-459d-9dd9-a20b7136e587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:15.886777 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9735313c-0e13-459d-9dd9-a20b7136e587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:15.887247 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9735313c-0e13-459d-9dd9-a20b7136e587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:16.024703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9735313c-0e13-459d-9dd9-a20b7136e587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:16.033976 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9735313c-0e13-459d-9dd9-a20b7136e587 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1681 microversion: 2.1 time: 0.164788 Jun 21 16:03:16.034640 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 464/946] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:15 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:16.375862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:16.376448 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:16.384443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:16.385822 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:16.386538 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:16.387249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:16.548653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:16.560016 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:16.561528 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:16.562754 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-afbe348c-1992-4982-930f-d14a4338a6c4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.191056 Jun 21 16:03:16.563317 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 483/947] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:16 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:17.052357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-976585b5-69ab-45bc-ac46-5a1bb1767936 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:17.052962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-976585b5-69ab-45bc-ac46-5a1bb1767936 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:17.059315 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-976585b5-69ab-45bc-ac46-5a1bb1767936 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:17.061276 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-976585b5-69ab-45bc-ac46-5a1bb1767936 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:17.062474 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-976585b5-69ab-45bc-ac46-5a1bb1767936 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:17.063124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-976585b5-69ab-45bc-ac46-5a1bb1767936 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:17.228497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-976585b5-69ab-45bc-ac46-5a1bb1767936 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:17.248778 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-976585b5-69ab-45bc-ac46-5a1bb1767936 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1681 microversion: 2.1 time: 0.199876 Jun 21 16:03:17.250110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 465/948] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:17 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:03:17.581527 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:17.582093 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:17.589805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:17.590379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:17.591485 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:17.592121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:17.784008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:17.796505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:17.798229 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:17.799445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-559335b7-1ff3-4d2d-9211-1dd319acc14f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.222176 Jun 21 16:03:17.799723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-5d606c9a-4ceb-400b-8650-8eba71605093 req-0d59001d-fccb-440a-a9ef-0fa50950f022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4c7c0a-54a2-4047-85b8-13456b2fb6b7", "name": "network-vif-deleted", "tag": "e6c8b845-e0d8-422d-b238-eee6d7a2ce83"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:17.800924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 484/949] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:17 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:17.820965 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-5d606c9a-4ceb-400b-8650-8eba71605093 req-0d59001d-fccb-440a-a9ef-0fa50950f022 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:17.821409 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-5d606c9a-4ceb-400b-8650-8eba71605093 req-0d59001d-fccb-440a-a9ef-0fa50950f022 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:17.857223 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-5d606c9a-4ceb-400b-8650-8eba71605093 req-0d59001d-fccb-440a-a9ef-0fa50950f022 service nova] Creating event network-vif-deleted:e6c8b845-e0d8-422d-b238-eee6d7a2ce83 for instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 on hv-cinder-84067 Jun 21 16:03:17.865476 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-5d606c9a-4ceb-400b-8650-8eba71605093 req-0d59001d-fccb-440a-a9ef-0fa50950f022 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076578 Jun 21 16:03:17.878389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 466/950] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:03:18.268320 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:18.269247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:18.276359 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:18.277116 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:18.278148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:18.278797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:18.365832 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:18.368068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:18.370403 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'fault' on Instance uuid 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:03:18.459934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:18.469650 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4423fb58-1262-4b39-9c0b-311236241152 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 200 len: 1331 microversion: 2.1 time: 0.204344 Jun 21 16:03:18.472183 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 485/951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:18 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 1331 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:18.817541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:18.818248 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:18.828800 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:18.829586 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:18.830631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:18.831774 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:19.039184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:19.050421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:19.052110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:19.053437 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d984af8e-f311-443e-acfa-44798eb9b727 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.240277 Jun 21 16:03:19.054125 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 467/952] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:18 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:19.493478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:19.497922 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:19.508017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:19.509361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:19.510556 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:19.511215 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:19.532176 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 HTTP/1.1 Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:03:19.533879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:03:19.535296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '5c4c7c0a-54a2-4047-85b8-13456b2fb6b7'} Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:03:19.536212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:03:19.538109 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:03:19.541072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:03:19.542472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2f6e7347-ac03-4526-8fcd-d367476d2d2e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 404 len: 111 microversion: 2.1 time: 0.055289 Jun 21 16:03:19.547605 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 486/953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:19 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:03:19.552809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6ad8bd02-6643-4269-990d-689715ec1d76 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '.version_select at 0x7f73b5caba60>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:19.581768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6ad8bd02-6643-4269-990d-689715ec1d76 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-866948492" status: 202 len: 0 microversion: 2.1 time: 0.033265 Jun 21 16:03:19.582903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 468/954] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Jun 21 16:03:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-866948492 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 16:03:20.074797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:20.076083 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:20.084925 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:20.086944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:20.087973 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:20.090074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:20.531836 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:20.546375 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:20.550796 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:20.552390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-73f43719-9280-41d4-9c7f-1be7e9bfbf88 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.483710 Jun 21 16:03:20.564265 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 487/955] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:20 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:20.891076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9c70714d-0b89-4240-9a2b-e40a6f330475 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: .version_select at 0x7f73b5c61700>, body: {"keypair": {"name": "tempest-keypair-757059273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnO3Ha7gaWXr7FL0LqT9QG9YhJErK/JO8QvnVctdN/g5sP3bHKQPnqX1j1v0BPL9zhuRgzgLepURrV5dpjVwusOkgwoRIAl/lxNdAjtRF/M8pH2JWmcFiTsE5ncpAN6yA=="}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:20.911239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-9c70714d-0b89-4240-9a2b-e40a6f330475 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for project d20d29454c00499282eb86547eeb4c10. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:03:20.915734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-9c70714d-0b89-4240-9a2b-e40a6f330475 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for user 9a67a5c4b7034d22b78331b907cc20bc and project d20d29454c00499282eb86547eeb4c10. Resources: {'key_pairs'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:03:20.951718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9c70714d-0b89-4240-9a2b-e40a6f330475 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063878 Jun 21 16:03:20.953303 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 469/956] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 16:03:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:21.582301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:21.584172 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:21.598544 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:21.599276 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:21.600230 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:21.600833 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:21.817408 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:21.827141 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:21.832660 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:21.833957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-196b05a2-d95a-4820-8257-904289dca37f tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.262809 Jun 21 16:03:21.839243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 488/957] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:21 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:22.861486 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:22.869556 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:22.887703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:22.888517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:22.889669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:22.889983 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-468198721", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cdeeb75-9f47-4354-8a71-6e4a191914df"}], "security_groups": [{"name": "tempest-securitygroup--699839097"}], "key_name": "tempest-keypair-757059273", "user_data": "}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:22.891022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:23.245525 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] validate_networks() for [('5cdeeb75-9f47-4354-8a71-6e4a191914df', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:03:23.333854 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:23.351515 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:23.353399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:23.359006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f225e19b-77d7-43c1-93fc-fbb55f72c26c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.506123 Jun 21 16:03:23.359590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 470/958] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:22 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:24.092351 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:03:24.092933 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:03:24.093223 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:03:24.093627 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:03:24.094047 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:03:24.110564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:24.111396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:24.113164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:24.115874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:24.147454 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for project d20d29454c00499282eb86547eeb4c10. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:03:24.157319 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Getting quotas for user 9a67a5c4b7034d22b78331b907cc20bc and project d20d29454c00499282eb86547eeb4c10. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:03:24.181057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:03:24.185668 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:03:24.296911 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-39cec8d0-d652-47e9-9265-aa1a6eb37a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.412545 Jun 21 16:03:24.298217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 489/959] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:03:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:03:24.308177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-892da0f3-b6e8-4f6f-bab5-89c3160f5d85 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:24.314780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-892da0f3-b6e8-4f6f-bab5-89c3160f5d85 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:24.385759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:24.386458 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:24.400416 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:24.400904 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:24.401708 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:24.408165 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:24.421545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-892da0f3-b6e8-4f6f-bab5-89c3160f5d85 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:24.429083 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-892da0f3-b6e8-4f6f-bab5-89c3160f5d85 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1240 microversion: 2.1 time: 0.124934 Jun 21 16:03:24.434383 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 471/960] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:24 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1240 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:24.652648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:24.671613 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:24.689802 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:24.695395 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b3754f2d-487d-40d2-963e-58ce779b8ec9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.314421 Jun 21 16:03:24.698864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 490/961] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:24 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:25.452793 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0c05af61-6f0b-4921-b8f0-1abb88e88a98 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:25.454263 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0c05af61-6f0b-4921-b8f0-1abb88e88a98 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:25.464917 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c05af61-6f0b-4921-b8f0-1abb88e88a98 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:25.466379 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c05af61-6f0b-4921-b8f0-1abb88e88a98 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:25.467408 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c05af61-6f0b-4921-b8f0-1abb88e88a98 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:25.468275 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c05af61-6f0b-4921-b8f0-1abb88e88a98 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:25.588819 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0c05af61-6f0b-4921-b8f0-1abb88e88a98 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:25.598336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0c05af61-6f0b-4921-b8f0-1abb88e88a98 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1292 microversion: 2.1 time: 0.150765 Jun 21 16:03:25.599260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 472/962] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:25 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1292 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:25.720557 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:25.721973 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:25.733505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:25.734484 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:25.735666 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:25.736311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:25.903445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:25.914486 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:25.916155 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:25.917353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-05dc9c47-7c2c-477d-8980-fa80f7bedb6e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.203653 Jun 21 16:03:25.918546 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 491/963] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:25 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:26.181686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-973176459", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "networks": [{"uuid": "05ce3fb1-9c19-4c59-8785-e2b2e38b7e34"}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:26.422162 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] validate_networks() for [('05ce3fb1-9c19-4c59-8785-e2b2e38b7e34', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:03:26.617114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-33107d52-733b-4552-ade7-492587dbcac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:26.618118 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-33107d52-733b-4552-ade7-492587dbcac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:26.625089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-33107d52-733b-4552-ade7-492587dbcac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:26.625542 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-33107d52-733b-4552-ade7-492587dbcac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:26.626341 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-33107d52-733b-4552-ade7-492587dbcac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:26.626772 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-33107d52-733b-4552-ade7-492587dbcac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:26.864810 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-33107d52-733b-4552-ade7-492587dbcac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:26.876632 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-33107d52-733b-4552-ade7-492587dbcac4 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.263823 Jun 21 16:03:26.877739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 492/964] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:26 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:26.932067 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:03:26.932592 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:03:26.932999 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:03:26.933401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:03:26.934106 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:03:26.941873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:26.943416 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:26.945700 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:26.946323 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:26.947115 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:26.947773 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:26.953152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:26.954127 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:26.955598 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:26.956285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:26.966939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Getting quotas for project 69b62d21e3d54a5592e26594c6483188. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:03:26.971234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Getting quotas for user 57bdca8c562a42a3af75f4d7d36bdecc and project 69b62d21e3d54a5592e26594c6483188. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:03:26.983162 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:03:26.985758 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:03:27.050364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3818b021-d998-4066-9a88-c3f1a4a4537c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879259 Jun 21 16:03:27.051029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 473/965] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:03:27.069618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-338029dc-8458-4618-a62a-5258b0ddc326 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:27.070323 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-338029dc-8458-4618-a62a-5258b0ddc326 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:27.174725 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-338029dc-8458-4618-a62a-5258b0ddc326 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:27.187098 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-338029dc-8458-4618-a62a-5258b0ddc326 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1213 microversion: 2.1 time: 0.122174 Jun 21 16:03:27.187794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 474/966] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:27 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:03:27.198814 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:27.221017 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:27.227916 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:27.229852 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2c58ebde-7cd7-4c64-a709-36d8d3e96e0a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1738 microversion: 2.20 time: 0.296181 Jun 21 16:03:27.233405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 493/967] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:26 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:27.560110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-708f8219-d088-487b-91f1-92af1c329e74 req-40a1be22-63a8-4edd-a2ba-d0024b6b21bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ab9a81-3476-46df-85c7-3cf8b2cf8682", "tag": "e4b17c80-6acf-43ca-a73a-47b97676a4fc"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:27.599070 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-708f8219-d088-487b-91f1-92af1c329e74 req-40a1be22-63a8-4edd-a2ba-d0024b6b21bc service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:27.599845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-708f8219-d088-487b-91f1-92af1c329e74 req-40a1be22-63a8-4edd-a2ba-d0024b6b21bc service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:27.621341 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-708f8219-d088-487b-91f1-92af1c329e74 req-40a1be22-63a8-4edd-a2ba-d0024b6b21bc service nova] Creating event network-changed:e4b17c80-6acf-43ca-a73a-47b97676a4fc for instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 on hv-cinder-84067 Jun 21 16:03:27.635416 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-708f8219-d088-487b-91f1-92af1c329e74 req-40a1be22-63a8-4edd-a2ba-d0024b6b21bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081208 Jun 21 16:03:27.638843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 475/968] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:27.899173 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8e5b951f-2d7c-46a4-9b7c-bfaa7b140792 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:27.906338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8e5b951f-2d7c-46a4-9b7c-bfaa7b140792 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:27.920278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8e5b951f-2d7c-46a4-9b7c-bfaa7b140792 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:27.920907 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8e5b951f-2d7c-46a4-9b7c-bfaa7b140792 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:27.921885 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8e5b951f-2d7c-46a4-9b7c-bfaa7b140792 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:27.922475 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8e5b951f-2d7c-46a4-9b7c-bfaa7b140792 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:28.074901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8e5b951f-2d7c-46a4-9b7c-bfaa7b140792 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:28.085111 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8e5b951f-2d7c-46a4-9b7c-bfaa7b140792 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.193436 Jun 21 16:03:28.085726 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 494/969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:27 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:28.206382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-574c4999-c5df-43f4-9235-5baba74e7df1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:28.206382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-574c4999-c5df-43f4-9235-5baba74e7df1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:28.212675 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-574c4999-c5df-43f4-9235-5baba74e7df1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:28.213094 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-574c4999-c5df-43f4-9235-5baba74e7df1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:28.213903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-574c4999-c5df-43f4-9235-5baba74e7df1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:28.214364 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-574c4999-c5df-43f4-9235-5baba74e7df1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:28.258465 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:28.259089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:28.268078 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:28.268565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:28.269505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:28.269968 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:28.281371 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-574c4999-c5df-43f4-9235-5baba74e7df1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:28.289315 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-574c4999-c5df-43f4-9235-5baba74e7df1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1265 microversion: 2.1 time: 0.089124 Jun 21 16:03:28.289946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 476/970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:28 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:28.472847 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:28.481639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:28.483196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:28.484380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-aa47702e-a9c7-4b9d-93c6-1ed93eabea9c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1720 microversion: 2.20 time: 0.229846 Jun 21 16:03:28.484934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 495/971] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:28 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:29.105405 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fc0a254a-5c51-4786-97cd-2a8f3a891689 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:29.106353 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fc0a254a-5c51-4786-97cd-2a8f3a891689 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:29.113320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fc0a254a-5c51-4786-97cd-2a8f3a891689 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:29.113946 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fc0a254a-5c51-4786-97cd-2a8f3a891689 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:29.114579 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fc0a254a-5c51-4786-97cd-2a8f3a891689 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:29.115022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fc0a254a-5c51-4786-97cd-2a8f3a891689 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:29.282651 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:29.308372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-41a198f9-5ef7-4b9c-a057-d81267802007 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:29.309238 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-41a198f9-5ef7-4b9c-a057-d81267802007 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:29.317629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41a198f9-5ef7-4b9c-a057-d81267802007 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:29.318104 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41a198f9-5ef7-4b9c-a057-d81267802007 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:29.318867 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41a198f9-5ef7-4b9c-a057-d81267802007 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:29.319297 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-41a198f9-5ef7-4b9c-a057-d81267802007 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:29.404919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-41a198f9-5ef7-4b9c-a057-d81267802007 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:29.412613 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-41a198f9-5ef7-4b9c-a057-d81267802007 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1265 microversion: 2.1 time: 0.107963 Jun 21 16:03:29.413654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 496/972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:29 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:29.436980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fc0a254a-5c51-4786-97cd-2a8f3a891689 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:29.444499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fc0a254a-5c51-4786-97cd-2a8f3a891689 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.344986 Jun 21 16:03:29.445054 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 477/973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:29 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:29.505026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:29.506018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:29.514134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:29.514707 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:29.515633 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:29.516164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:29.659951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:29.673070 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:29.681504 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:29.685277 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:29.688787 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-18624c0f-9fa6-4edd-8498-922c0124c0db tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1720 microversion: 2.20 time: 0.189002 Jun 21 16:03:29.690049 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 497/974] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:29 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:30.432195 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ab3dad2f-a597-4782-b693-d191d85943c5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:30.432790 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ab3dad2f-a597-4782-b693-d191d85943c5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:30.439792 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab3dad2f-a597-4782-b693-d191d85943c5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:30.440234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab3dad2f-a597-4782-b693-d191d85943c5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:30.441001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab3dad2f-a597-4782-b693-d191d85943c5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:30.441502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ab3dad2f-a597-4782-b693-d191d85943c5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:30.464503 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-bf9524ad-b0b4-4044-8a75-0d5c6915c1b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:30.465276 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-bf9524ad-b0b4-4044-8a75-0d5c6915c1b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:30.473641 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bf9524ad-b0b4-4044-8a75-0d5c6915c1b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:30.474954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bf9524ad-b0b4-4044-8a75-0d5c6915c1b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:30.475791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bf9524ad-b0b4-4044-8a75-0d5c6915c1b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:30.476239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-bf9524ad-b0b4-4044-8a75-0d5c6915c1b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:30.520523 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ab3dad2f-a597-4782-b693-d191d85943c5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:30.532296 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ab3dad2f-a597-4782-b693-d191d85943c5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1273 microversion: 2.1 time: 0.103640 Jun 21 16:03:30.533263 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 478/975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:30 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:30.623919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-bf9524ad-b0b4-4044-8a75-0d5c6915c1b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:30.632133 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-bf9524ad-b0b4-4044-8a75-0d5c6915c1b2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.173188 Jun 21 16:03:30.632709 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 498/976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:30 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:03:30.711277 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:30.711871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:30.718866 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:30.719308 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:30.720070 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:30.720504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:30.865875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:30.875171 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:30.877116 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:30.878772 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b5e45410-1c65-41e0-98c7-9bfe091e4217 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1720 microversion: 2.20 time: 0.171460 Jun 21 16:03:30.879365 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 479/977] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:30 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:31.416345 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-c20c837d-7466-4392-97e1-d312ea55964e req-f80a43e9-78fc-40be-b1fd-1c2fade0e6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cea78e9-1d9b-4b08-bbe5-93fadd09e685", "name": "network-vif-unplugged", "status": "completed", "tag": "b76d21d6-4f2c-4f99-a9ef-d06b45b48736"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:31.426667 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-c20c837d-7466-4392-97e1-d312ea55964e req-f80a43e9-78fc-40be-b1fd-1c2fade0e6d4 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:31.427127 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-c20c837d-7466-4392-97e1-d312ea55964e req-f80a43e9-78fc-40be-b1fd-1c2fade0e6d4 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:31.442162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-c20c837d-7466-4392-97e1-d312ea55964e req-f80a43e9-78fc-40be-b1fd-1c2fade0e6d4 service nova] Creating event network-vif-unplugged:b76d21d6-4f2c-4f99-a9ef-d06b45b48736 for instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 on hv-cinder-84067 Jun 21 16:03:31.447743 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-c20c837d-7466-4392-97e1-d312ea55964e req-f80a43e9-78fc-40be-b1fd-1c2fade0e6d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035512 Jun 21 16:03:31.448654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 499/978] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:31.552034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-553faa67-30bb-4197-89f2-460a266282e1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:31.552612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-553faa67-30bb-4197-89f2-460a266282e1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:31.560704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-553faa67-30bb-4197-89f2-460a266282e1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:31.561251 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-553faa67-30bb-4197-89f2-460a266282e1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:31.562217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-553faa67-30bb-4197-89f2-460a266282e1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:31.562655 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-553faa67-30bb-4197-89f2-460a266282e1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:31.639167 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-553faa67-30bb-4197-89f2-460a266282e1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:31.648192 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-553faa67-30bb-4197-89f2-460a266282e1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1273 microversion: 2.1 time: 0.101011 Jun 21 16:03:31.649141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 480/979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:31 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:31.653844 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5fd6f052-c07b-45ae-a890-676ebb2c4a03 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:31.654791 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5fd6f052-c07b-45ae-a890-676ebb2c4a03 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:31.666123 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5fd6f052-c07b-45ae-a890-676ebb2c4a03 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:31.666766 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5fd6f052-c07b-45ae-a890-676ebb2c4a03 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:31.668105 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5fd6f052-c07b-45ae-a890-676ebb2c4a03 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:31.668781 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5fd6f052-c07b-45ae-a890-676ebb2c4a03 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:31.815862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-5fd6f052-c07b-45ae-a890-676ebb2c4a03 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:31.824085 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5fd6f052-c07b-45ae-a890-676ebb2c4a03 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.176759 Jun 21 16:03:31.824661 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 500/980] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:31 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:31.896974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:31.897566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:31.904504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:31.904937 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:31.905869 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:31.906168 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:32.049959 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:32.057931 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:32.059415 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:32.060670 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-12546522-d530-42b2-88a0-dd2e55e46535 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1720 microversion: 2.20 time: 0.167706 Jun 21 16:03:32.061221 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 481/981] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:31 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:32.667266 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-99572121-8437-4108-bf32-62319cd4b898 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:32.668784 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-99572121-8437-4108-bf32-62319cd4b898 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:32.675761 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-99572121-8437-4108-bf32-62319cd4b898 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:32.676295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-99572121-8437-4108-bf32-62319cd4b898 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:32.677164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-99572121-8437-4108-bf32-62319cd4b898 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:32.677841 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-99572121-8437-4108-bf32-62319cd4b898 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:32.759447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-99572121-8437-4108-bf32-62319cd4b898 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:32.768054 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-99572121-8437-4108-bf32-62319cd4b898 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1271 microversion: 2.1 time: 0.105318 Jun 21 16:03:32.769066 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 501/982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:32 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:32.843497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c59d59b9-33a5-4928-8f96-160b99abc89d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:32.844712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c59d59b9-33a5-4928-8f96-160b99abc89d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:32.853522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c59d59b9-33a5-4928-8f96-160b99abc89d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:32.854060 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c59d59b9-33a5-4928-8f96-160b99abc89d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:32.854829 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c59d59b9-33a5-4928-8f96-160b99abc89d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:32.855232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c59d59b9-33a5-4928-8f96-160b99abc89d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:33.082053 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:33.082755 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:33.083183 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c59d59b9-33a5-4928-8f96-160b99abc89d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:33.089482 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:33.090111 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:33.091095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:33.091739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:33.092858 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c59d59b9-33a5-4928-8f96-160b99abc89d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.255093 Jun 21 16:03:33.102378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 482/983] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:32 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:33.276766 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:33.292241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:33.297678 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:33.299549 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2231c4b9-5bd3-4ed8-a35c-52db88bce75b tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1663 microversion: 2.20 time: 0.222665 Jun 21 16:03:33.309809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 502/984] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:33 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1663 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:33.323007 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-cdb2ef85-7db4-4305-b87f-0281906ecc79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbaf4e4f-769a-4595-a444-cd4378e613b7"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:33.324248 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-cdb2ef85-7db4-4305-b87f-0281906ecc79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:33.331076 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cdb2ef85-7db4-4305-b87f-0281906ecc79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:33.331725 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cdb2ef85-7db4-4305-b87f-0281906ecc79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:33.332560 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cdb2ef85-7db4-4305-b87f-0281906ecc79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:33.333506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cdb2ef85-7db4-4305-b87f-0281906ecc79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:33.678544 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-cdb2ef85-7db4-4305-b87f-0281906ecc79 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.360085 Jun 21 16:03:33.684048 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 483/985] 10.222.0.52 () {62 vars in 1363 bytes} [Tue Jun 21 16:03:33 2022] POST /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:03:33.786082 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d5ec35df-3f61-4123-8261-2be8915bffe7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:33.787297 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d5ec35df-3f61-4123-8261-2be8915bffe7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:33.801230 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d5ec35df-3f61-4123-8261-2be8915bffe7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:33.801687 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d5ec35df-3f61-4123-8261-2be8915bffe7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:33.802536 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d5ec35df-3f61-4123-8261-2be8915bffe7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:33.803111 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d5ec35df-3f61-4123-8261-2be8915bffe7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:33.809254 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-90602450-3583-4ce2-9fea-b55dd6a55c12 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:33.811211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-90602450-3583-4ce2-9fea-b55dd6a55c12 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:33.818308 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90602450-3583-4ce2-9fea-b55dd6a55c12 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:33.818716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90602450-3583-4ce2-9fea-b55dd6a55c12 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:33.819776 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90602450-3583-4ce2-9fea-b55dd6a55c12 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:33.820506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90602450-3583-4ce2-9fea-b55dd6a55c12 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:34.052380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d5ec35df-3f61-4123-8261-2be8915bffe7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:34.062350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d5ec35df-3f61-4123-8261-2be8915bffe7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.280094 Jun 21 16:03:34.063661 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 503/986] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:33 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:34.110707 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d3016134-6cef-459c-8c81-357f49d46a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:34.111638 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d3016134-6cef-459c-8c81-357f49d46a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:34.118785 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3016134-6cef-459c-8c81-357f49d46a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:34.119345 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3016134-6cef-459c-8c81-357f49d46a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:34.120223 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3016134-6cef-459c-8c81-357f49d46a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:34.120722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3016134-6cef-459c-8c81-357f49d46a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:34.134117 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-90602450-3583-4ce2-9fea-b55dd6a55c12 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/os-volume_attachments/bbaf4e4f-769a-4595-a444-cd4378e613b7" status: 202 len: 0 microversion: 2.20 time: 0.329366 Jun 21 16:03:34.138326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 484/987] 10.222.0.52 () {60 vars in 1456 bytes} [Tue Jun 21 16:03:33 2022] DELETE /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/os-volume_attachments/bbaf4e4f-769a-4595-a444-cd4378e613b7 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 16:03:34.138497 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:34.168008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=6 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:34.207066 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ad2f6c7f-a653-4abb-a383-e23bb0648bed tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:34.208250 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ad2f6c7f-a653-4abb-a383-e23bb0648bed tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:34.215277 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ad2f6c7f-a653-4abb-a383-e23bb0648bed tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:34.215691 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ad2f6c7f-a653-4abb-a383-e23bb0648bed tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:34.216522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ad2f6c7f-a653-4abb-a383-e23bb0648bed tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:34.217657 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ad2f6c7f-a653-4abb-a383-e23bb0648bed tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:34.307050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ad2f6c7f-a653-4abb-a383-e23bb0648bed tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "POST /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/action" status: 202 len: 0 microversion: 2.20 time: 0.103755 Jun 21 16:03:34.307974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 485/988] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jun 21 16:03:34 2022] POST /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:03:34.317808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-ad35e07b-daa2-4796-a0ea-2f3810b9d5d8 req-5be48b51-1ffa-48c5-91cd-8441c2dd62db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2401b1e9-284c-4a8d-b932-beb815806a32", "tag": "a2bb44a5-317c-4990-a31c-8f74b6120718"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:34.328395 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-ad35e07b-daa2-4796-a0ea-2f3810b9d5d8 req-5be48b51-1ffa-48c5-91cd-8441c2dd62db service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:34.328849 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-ad35e07b-daa2-4796-a0ea-2f3810b9d5d8 req-5be48b51-1ffa-48c5-91cd-8441c2dd62db service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:34.344062 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-ad35e07b-daa2-4796-a0ea-2f3810b9d5d8 req-5be48b51-1ffa-48c5-91cd-8441c2dd62db service nova] Creating event network-changed:a2bb44a5-317c-4990-a31c-8f74b6120718 for instance 2401b1e9-284c-4a8d-b932-beb815806a32 on hv-cinder-84067 Jun 21 16:03:34.350498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-ad35e07b-daa2-4796-a0ea-2f3810b9d5d8 req-5be48b51-1ffa-48c5-91cd-8441c2dd62db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037363 Jun 21 16:03:34.351881 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 486/989] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:34.361146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:34.362104 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:34.369879 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:34.370614 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:34.371554 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:34.371734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d3016134-6cef-459c-8c81-357f49d46a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:34.372428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:34.390841 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d3016134-6cef-459c-8c81-357f49d46a68 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.283995 Jun 21 16:03:34.395331 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 504/990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:34 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:03:34.600624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:34.610381 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:34.611989 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:34.613308 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-827c40b1-1105-48fc-8f46-8928e7bdaa94 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1671 microversion: 2.20 time: 0.259626 Jun 21 16:03:34.615834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 487/991] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:34 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1671 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:35.083463 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fac9316f-fee2-4170-b9b0-9430fcdd218d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:35.084025 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fac9316f-fee2-4170-b9b0-9430fcdd218d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:35.090489 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fac9316f-fee2-4170-b9b0-9430fcdd218d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:35.091206 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fac9316f-fee2-4170-b9b0-9430fcdd218d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:35.092264 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fac9316f-fee2-4170-b9b0-9430fcdd218d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:35.092883 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fac9316f-fee2-4170-b9b0-9430fcdd218d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:35.228438 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fac9316f-fee2-4170-b9b0-9430fcdd218d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:35.240616 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fac9316f-fee2-4170-b9b0-9430fcdd218d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.161720 Jun 21 16:03:35.250189 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 505/992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:35 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:35.413166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ac30032d-9ea8-40db-bd7a-ff69aa4378cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:35.414090 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ac30032d-9ea8-40db-bd7a-ff69aa4378cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:35.421401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ac30032d-9ea8-40db-bd7a-ff69aa4378cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:35.421995 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ac30032d-9ea8-40db-bd7a-ff69aa4378cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:35.422840 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ac30032d-9ea8-40db-bd7a-ff69aa4378cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:35.423339 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ac30032d-9ea8-40db-bd7a-ff69aa4378cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:35.442580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:35.473214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-ce50e250-b46a-4354-a79f-150d45c14ad9 req-2442d063-402e-431b-96c7-48a564985a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ab9a81-3476-46df-85c7-3cf8b2cf8682", "name": "network-vif-plugged", "status": "completed", "tag": "e4b17c80-6acf-43ca-a73a-47b97676a4fc"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:35.490096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-ce50e250-b46a-4354-a79f-150d45c14ad9 req-2442d063-402e-431b-96c7-48a564985a82 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:35.490096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-ce50e250-b46a-4354-a79f-150d45c14ad9 req-2442d063-402e-431b-96c7-48a564985a82 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:35.511094 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-ce50e250-b46a-4354-a79f-150d45c14ad9 req-2442d063-402e-431b-96c7-48a564985a82 service nova] Creating event network-vif-plugged:e4b17c80-6acf-43ca-a73a-47b97676a4fc for instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 on hv-cinder-84067 Jun 21 16:03:35.521235 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-ce50e250-b46a-4354-a79f-150d45c14ad9 req-2442d063-402e-431b-96c7-48a564985a82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053648 Jun 21 16:03:35.522698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 506/993] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:35.588612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ac30032d-9ea8-40db-bd7a-ff69aa4378cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:35.601830 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ac30032d-9ea8-40db-bd7a-ff69aa4378cd tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.192083 Jun 21 16:03:35.602490 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 488/994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:35 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:35.645420 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:35.646472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:35.655160 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:35.655728 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:35.656787 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:35.657423 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:35.807704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:35.818793 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:35.820559 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:35.821953 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-54496b01-0fec-47c8-9b83-e3d00d7d9290 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1673 microversion: 2.20 time: 0.182563 Jun 21 16:03:35.822577 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 507/995] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:35 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:36.264755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f9c2a9e7-8d2a-4141-962f-ccf612ab59e7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:36.265355 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f9c2a9e7-8d2a-4141-962f-ccf612ab59e7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:36.271859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9c2a9e7-8d2a-4141-962f-ccf612ab59e7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:36.272303 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9c2a9e7-8d2a-4141-962f-ccf612ab59e7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:36.273072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9c2a9e7-8d2a-4141-962f-ccf612ab59e7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:36.273498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f9c2a9e7-8d2a-4141-962f-ccf612ab59e7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:36.429097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f9c2a9e7-8d2a-4141-962f-ccf612ab59e7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:36.436829 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f9c2a9e7-8d2a-4141-962f-ccf612ab59e7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.176749 Jun 21 16:03:36.437370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 489/996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:36 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:36.624606 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-963a4313-063b-4d2f-a90b-945d98b01716 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:36.625145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-963a4313-063b-4d2f-a90b-945d98b01716 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:36.632234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-963a4313-063b-4d2f-a90b-945d98b01716 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:36.632706 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-963a4313-063b-4d2f-a90b-945d98b01716 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:36.633455 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-963a4313-063b-4d2f-a90b-945d98b01716 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:36.633915 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-963a4313-063b-4d2f-a90b-945d98b01716 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:36.777156 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-963a4313-063b-4d2f-a90b-945d98b01716 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:36.787688 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-963a4313-063b-4d2f-a90b-945d98b01716 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.168787 Jun 21 16:03:36.788390 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 508/997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:36 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:36.846982 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:36.847581 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:36.849432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:36.854971 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:36.855413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:36.856173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:36.856595 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:36.958038 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:37.000206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:37.008394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:37.009909 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:37.011078 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fca0c64d-a455-4620-89c3-fce9e3af60d1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1673 microversion: 2.20 time: 0.168920 Jun 21 16:03:37.011633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 490/998] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:36 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:37.454283 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a55fc5ed-f452-4c79-9e6f-7b78f53064e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:37.454885 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a55fc5ed-f452-4c79-9e6f-7b78f53064e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:37.461398 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a55fc5ed-f452-4c79-9e6f-7b78f53064e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:37.461876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a55fc5ed-f452-4c79-9e6f-7b78f53064e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:37.462644 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a55fc5ed-f452-4c79-9e6f-7b78f53064e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:37.463072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a55fc5ed-f452-4c79-9e6f-7b78f53064e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:37.598013 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a55fc5ed-f452-4c79-9e6f-7b78f53064e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:37.606267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a55fc5ed-f452-4c79-9e6f-7b78f53064e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.156278 Jun 21 16:03:37.606840 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 509/999] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:37 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:37.806048 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e4a04270-4ca7-4636-9287-5b79b239e2be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:37.806600 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e4a04270-4ca7-4636-9287-5b79b239e2be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:37.808470 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=14 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:37.815208 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e4a04270-4ca7-4636-9287-5b79b239e2be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:37.815655 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e4a04270-4ca7-4636-9287-5b79b239e2be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:37.816432 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e4a04270-4ca7-4636-9287-5b79b239e2be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:37.816872 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e4a04270-4ca7-4636-9287-5b79b239e2be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:38.030837 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:38.032252 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:38.037074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:38.045063 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:38.045663 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:38.046480 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:38.046914 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:38.056226 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e4a04270-4ca7-4636-9287-5b79b239e2be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:38.065221 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e4a04270-4ca7-4636-9287-5b79b239e2be tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.263475 Jun 21 16:03:38.066162 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 491/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:37 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:38.194457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:38.207367 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:38.209457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:38.211304 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2b596a44-290f-4d36-9628-ca20a40b8886 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.186509 Jun 21 16:03:38.212093 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 510/1001] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:38 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:38.623995 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f18f6197-68af-4073-9e5b-98e878261adf tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:38.624508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f18f6197-68af-4073-9e5b-98e878261adf tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:38.634025 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f18f6197-68af-4073-9e5b-98e878261adf tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:38.634569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f18f6197-68af-4073-9e5b-98e878261adf tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:38.635369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f18f6197-68af-4073-9e5b-98e878261adf tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:38.635809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f18f6197-68af-4073-9e5b-98e878261adf tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:38.848239 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f18f6197-68af-4073-9e5b-98e878261adf tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:38.856450 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f18f6197-68af-4073-9e5b-98e878261adf tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.236541 Jun 21 16:03:38.857231 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 492/1002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:38 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:39.083797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-35aa21ef-00d6-4de3-b1d1-c06a2d5786af tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:39.084373 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-35aa21ef-00d6-4de3-b1d1-c06a2d5786af tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:39.091414 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35aa21ef-00d6-4de3-b1d1-c06a2d5786af tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:39.091414 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35aa21ef-00d6-4de3-b1d1-c06a2d5786af tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:39.092820 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35aa21ef-00d6-4de3-b1d1-c06a2d5786af tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:39.093257 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-35aa21ef-00d6-4de3-b1d1-c06a2d5786af tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:39.232099 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:39.232712 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:39.234350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-35aa21ef-00d6-4de3-b1d1-c06a2d5786af tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:39.240294 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:39.240745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:39.241511 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:39.241980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:39.242290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-35aa21ef-00d6-4de3-b1d1-c06a2d5786af tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1365 microversion: 2.1 time: 0.162351 Jun 21 16:03:39.251047 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 511/1003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:39 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:39.380117 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:39.388597 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:39.390912 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:39.392149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5a49901f-0c8f-4879-9ea1-7075c89f71ac tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.164100 Jun 21 16:03:39.392705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 493/1004] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:39 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:39.876477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-aeba2030-ed4e-418f-b8c3-c3bc53cc2cbd tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:39.877400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-aeba2030-ed4e-418f-b8c3-c3bc53cc2cbd tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:39.896048 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aeba2030-ed4e-418f-b8c3-c3bc53cc2cbd tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:39.896770 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aeba2030-ed4e-418f-b8c3-c3bc53cc2cbd tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:39.898097 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aeba2030-ed4e-418f-b8c3-c3bc53cc2cbd tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:39.898729 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aeba2030-ed4e-418f-b8c3-c3bc53cc2cbd tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:40.041214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aeba2030-ed4e-418f-b8c3-c3bc53cc2cbd tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:40.049051 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-aeba2030-ed4e-418f-b8c3-c3bc53cc2cbd tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.179399 Jun 21 16:03:40.049660 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 512/1005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:39 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:40.259612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7e1af363-8b46-4d6b-90b4-45cfa0c68c25 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:40.260219 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7e1af363-8b46-4d6b-90b4-45cfa0c68c25 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:40.268574 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7e1af363-8b46-4d6b-90b4-45cfa0c68c25 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:40.269045 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7e1af363-8b46-4d6b-90b4-45cfa0c68c25 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:40.269921 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7e1af363-8b46-4d6b-90b4-45cfa0c68c25 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:40.270468 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7e1af363-8b46-4d6b-90b4-45cfa0c68c25 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:40.408123 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7e1af363-8b46-4d6b-90b4-45cfa0c68c25 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:40.415225 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:40.416531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:40.416698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7e1af363-8b46-4d6b-90b4-45cfa0c68c25 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1555 microversion: 2.1 time: 0.161048 Jun 21 16:03:40.428685 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 494/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:40 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:40.429248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:40.429248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:40.429248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:40.429248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:40.436236 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8fe89060-16c6-4bd0-9e24-23570054429f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:40.437146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8fe89060-16c6-4bd0-9e24-23570054429f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:40.443976 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8fe89060-16c6-4bd0-9e24-23570054429f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:40.444917 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8fe89060-16c6-4bd0-9e24-23570054429f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:40.446034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8fe89060-16c6-4bd0-9e24-23570054429f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:40.446788 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8fe89060-16c6-4bd0-9e24-23570054429f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:40.564121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8fe89060-16c6-4bd0-9e24-23570054429f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132011 Jun 21 16:03:40.565001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 495/1007] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jun 21 16:03:40 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:40.617891 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:40.630694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:40.632201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:40.633443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-405dd8b0-4efb-40ba-82e7-2b1565deb015 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.226189 Jun 21 16:03:40.636595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 513/1008] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:40 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:41.067777 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f74f7117-a832-425a-b6e1-c775976d01e0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:41.068910 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f74f7117-a832-425a-b6e1-c775976d01e0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:41.081429 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f74f7117-a832-425a-b6e1-c775976d01e0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:41.089288 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f74f7117-a832-425a-b6e1-c775976d01e0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:41.090330 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f74f7117-a832-425a-b6e1-c775976d01e0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:41.090871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f74f7117-a832-425a-b6e1-c775976d01e0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:41.299594 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f74f7117-a832-425a-b6e1-c775976d01e0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:41.307883 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f74f7117-a832-425a-b6e1-c775976d01e0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.244017 Jun 21 16:03:41.308467 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 496/1009] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:41 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:41.536642 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-6ac3ea95-45b3-4c6f-ac0e-6b8d82806bc6 req-7f63b022-f361-4383-ac18-38e9370599fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2401b1e9-284c-4a8d-b932-beb815806a32", "name": "network-vif-plugged", "status": "completed", "tag": "a2bb44a5-317c-4990-a31c-8f74b6120718"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:41.546569 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-6ac3ea95-45b3-4c6f-ac0e-6b8d82806bc6 req-7f63b022-f361-4383-ac18-38e9370599fe service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:41.547217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-6ac3ea95-45b3-4c6f-ac0e-6b8d82806bc6 req-7f63b022-f361-4383-ac18-38e9370599fe service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:41.581379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-6ac3ea95-45b3-4c6f-ac0e-6b8d82806bc6 req-7f63b022-f361-4383-ac18-38e9370599fe service nova] Creating event network-vif-plugged:a2bb44a5-317c-4990-a31c-8f74b6120718 for instance 2401b1e9-284c-4a8d-b932-beb815806a32 on hv-cinder-84067 Jun 21 16:03:41.592928 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-6ac3ea95-45b3-4c6f-ac0e-6b8d82806bc6 req-7f63b022-f361-4383-ac18-38e9370599fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060255 Jun 21 16:03:41.597255 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 514/1010] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:41.653135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:41.654029 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:41.666992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:41.667690 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:41.668657 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:41.669183 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:41.864120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:41.874096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:41.879373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:41.880966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-11cc0595-29f9-4d53-8afa-80b80323afde tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.233678 Jun 21 16:03:41.881698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 497/1011] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:41 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:42.136261 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-e68c6dc2-dd92-4e9d-869a-31c6ea5cca6f req-9191b826-f11e-4c57-9080-8725170c56f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ab9a81-3476-46df-85c7-3cf8b2cf8682", "tag": "e4b17c80-6acf-43ca-a73a-47b97676a4fc"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:42.148613 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-e68c6dc2-dd92-4e9d-869a-31c6ea5cca6f req-9191b826-f11e-4c57-9080-8725170c56f4 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:42.149737 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-e68c6dc2-dd92-4e9d-869a-31c6ea5cca6f req-9191b826-f11e-4c57-9080-8725170c56f4 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:42.172619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-e68c6dc2-dd92-4e9d-869a-31c6ea5cca6f req-9191b826-f11e-4c57-9080-8725170c56f4 service nova] Creating event network-changed:e4b17c80-6acf-43ca-a73a-47b97676a4fc for instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 on hv-cinder-84067 Jun 21 16:03:42.180831 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-e68c6dc2-dd92-4e9d-869a-31c6ea5cca6f req-9191b826-f11e-4c57-9080-8725170c56f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048666 Jun 21 16:03:42.182207 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 515/1012] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:42.335024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f78e1484-b910-4509-9507-139671dba825 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:42.336328 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f78e1484-b910-4509-9507-139671dba825 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:42.345668 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f78e1484-b910-4509-9507-139671dba825 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:42.346448 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f78e1484-b910-4509-9507-139671dba825 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:42.347388 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f78e1484-b910-4509-9507-139671dba825 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:42.348157 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f78e1484-b910-4509-9507-139671dba825 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:42.536557 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f78e1484-b910-4509-9507-139671dba825 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:42.545415 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f78e1484-b910-4509-9507-139671dba825 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.215362 Jun 21 16:03:42.554086 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 498/1013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:42 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:42.900733 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:42.902189 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:42.909750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:42.910146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:42.910951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:42.911391 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:43.090979 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:43.102866 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:43.104703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:43.106134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-844cc9ea-7ac4-4dc9-bf0d-1e76a54a4e51 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.209942 Jun 21 16:03:43.107280 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 516/1014] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:42 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:43.564795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a0e3160e-747a-4b5b-8709-982083815952 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:43.565332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a0e3160e-747a-4b5b-8709-982083815952 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:43.572906 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0e3160e-747a-4b5b-8709-982083815952 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:43.573326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0e3160e-747a-4b5b-8709-982083815952 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:43.574197 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0e3160e-747a-4b5b-8709-982083815952 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:43.574623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a0e3160e-747a-4b5b-8709-982083815952 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:43.722425 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a0e3160e-747a-4b5b-8709-982083815952 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:43.736576 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a0e3160e-747a-4b5b-8709-982083815952 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.177564 Jun 21 16:03:43.737611 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 499/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:43 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:03:44.126046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:44.127052 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:44.134461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:44.135005 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:44.135846 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:44.136353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:44.141130 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=100 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:44.284515 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:44.297627 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:44.299138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:44.300753 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6966ad09-e6e5-42f2-a787-0f86c5bd5835 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.179483 Jun 21 16:03:44.301548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 517/1016] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:44 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:44.754483 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8dfe69f6-ff34-4ddf-a9b3-d5fb1df0e4f2 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:44.755080 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8dfe69f6-ff34-4ddf-a9b3-d5fb1df0e4f2 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:44.762436 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8dfe69f6-ff34-4ddf-a9b3-d5fb1df0e4f2 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:44.762875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8dfe69f6-ff34-4ddf-a9b3-d5fb1df0e4f2 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:44.763698 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8dfe69f6-ff34-4ddf-a9b3-d5fb1df0e4f2 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:44.764152 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8dfe69f6-ff34-4ddf-a9b3-d5fb1df0e4f2 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:44.916801 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8dfe69f6-ff34-4ddf-a9b3-d5fb1df0e4f2 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:44.925564 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8dfe69f6-ff34-4ddf-a9b3-d5fb1df0e4f2 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.175773 Jun 21 16:03:44.926740 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 500/1017] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:44 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:45.320548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:45.321184 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:45.328077 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:45.328531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:45.329629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:45.330134 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:45.479795 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:45.489469 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:45.491726 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:45.492981 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-23ccf50c-63fe-4ddd-8886-42966ba7fae4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.177658 Jun 21 16:03:45.493554 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 518/1018] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:45 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:45.944290 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ee5005f2-665c-4122-9f38-c5b1ce2cf609 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:45.944926 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ee5005f2-665c-4122-9f38-c5b1ce2cf609 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:45.952045 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee5005f2-665c-4122-9f38-c5b1ce2cf609 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:45.952499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee5005f2-665c-4122-9f38-c5b1ce2cf609 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:45.953466 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee5005f2-665c-4122-9f38-c5b1ce2cf609 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:45.953948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee5005f2-665c-4122-9f38-c5b1ce2cf609 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:46.097426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ee5005f2-665c-4122-9f38-c5b1ce2cf609 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:46.106653 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ee5005f2-665c-4122-9f38-c5b1ce2cf609 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.166077 Jun 21 16:03:46.107063 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 501/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:45 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:46.512041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:46.512862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:46.520317 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:46.520780 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:46.521691 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:46.522189 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:46.669688 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:46.679676 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:46.681714 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:46.683731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f32987f0-7e1b-4a99-a9d7-5adf513296e4 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.175549 Jun 21 16:03:46.684762 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 519/1020] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:46 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:47.123399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-40b2781a-a41f-4d4f-829b-219fcf0a2e80 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:47.124018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-40b2781a-a41f-4d4f-829b-219fcf0a2e80 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:47.131817 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-40b2781a-a41f-4d4f-829b-219fcf0a2e80 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:47.132268 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-40b2781a-a41f-4d4f-829b-219fcf0a2e80 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:47.133021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-40b2781a-a41f-4d4f-829b-219fcf0a2e80 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:47.133452 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-40b2781a-a41f-4d4f-829b-219fcf0a2e80 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:47.291719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-40b2781a-a41f-4d4f-829b-219fcf0a2e80 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:47.300042 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-40b2781a-a41f-4d4f-829b-219fcf0a2e80 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.180445 Jun 21 16:03:47.300970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 502/1021] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:47 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:47.706675 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:47.707317 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:47.715643 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:47.716599 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:47.717805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:47.718591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:47.865289 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:47.874485 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:47.877084 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:47.878795 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-daafd710-fffd-40bd-b78e-3f011f64c397 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.179263 Jun 21 16:03:47.879366 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 520/1022] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:47 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:48.317256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2b1f33ab-a601-4b56-89a9-e45f7cb03627 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:48.317933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2b1f33ab-a601-4b56-89a9-e45f7cb03627 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:48.325161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2b1f33ab-a601-4b56-89a9-e45f7cb03627 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:48.325609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2b1f33ab-a601-4b56-89a9-e45f7cb03627 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:48.326433 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2b1f33ab-a601-4b56-89a9-e45f7cb03627 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:48.326861 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2b1f33ab-a601-4b56-89a9-e45f7cb03627 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:48.499493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2b1f33ab-a601-4b56-89a9-e45f7cb03627 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:48.507530 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2b1f33ab-a601-4b56-89a9-e45f7cb03627 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.194398 Jun 21 16:03:48.508035 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 503/1023] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:48 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:48.898835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:48.899397 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:48.906563 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:48.907128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:48.907946 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:48.908541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:49.059689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:49.068399 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:49.072511 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:49.073737 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1ee986b7-ef9c-4a54-9c8f-041969fc86ce tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.178722 Jun 21 16:03:49.074939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 521/1024] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:48 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:49.524705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bbe81f6c-6741-4fbb-ac4b-cde07f7708b1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:49.525313 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bbe81f6c-6741-4fbb-ac4b-cde07f7708b1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:49.532234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bbe81f6c-6741-4fbb-ac4b-cde07f7708b1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:49.532674 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bbe81f6c-6741-4fbb-ac4b-cde07f7708b1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:49.533607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bbe81f6c-6741-4fbb-ac4b-cde07f7708b1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:49.534088 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bbe81f6c-6741-4fbb-ac4b-cde07f7708b1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:49.674803 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-bbe81f6c-6741-4fbb-ac4b-cde07f7708b1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:49.682387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bbe81f6c-6741-4fbb-ac4b-cde07f7708b1 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.161657 Jun 21 16:03:49.682970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 504/1025] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:49 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:50.259423 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:50.260028 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:50.266072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:50.267177 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:50.267965 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:50.268401 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:50.417113 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:50.427417 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:50.429667 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:50.431447 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-1bffa8d1-e6d9-4c47-a9d6-d41cd803bc73 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.341088 Jun 21 16:03:50.432232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 522/1026] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:50 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:50.702111 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a92c72cc-e4b5-4428-8b2e-1f06cd621df8 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:50.702952 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a92c72cc-e4b5-4428-8b2e-1f06cd621df8 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:50.710350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a92c72cc-e4b5-4428-8b2e-1f06cd621df8 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:50.710789 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a92c72cc-e4b5-4428-8b2e-1f06cd621df8 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:50.711551 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a92c72cc-e4b5-4428-8b2e-1f06cd621df8 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:50.711974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a92c72cc-e4b5-4428-8b2e-1f06cd621df8 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:50.730415 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:50.867206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a92c72cc-e4b5-4428-8b2e-1f06cd621df8 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:50.875417 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a92c72cc-e4b5-4428-8b2e-1f06cd621df8 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.179363 Jun 21 16:03:50.876042 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 505/1027] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:50 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:51.451550 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:51.452170 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:51.460153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:51.460595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:51.461354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:51.461800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:51.606797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:51.619567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:51.621835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:51.623533 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-91a34c2d-7067-4bc2-a01a-08100e06e506 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.176592 Jun 21 16:03:51.624289 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 523/1028] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:51 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:51.892496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-31dc48c3-fe30-4518-9366-0fdf65df315b tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:51.893077 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-31dc48c3-fe30-4518-9366-0fdf65df315b tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:51.900642 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-31dc48c3-fe30-4518-9366-0fdf65df315b tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:51.901084 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-31dc48c3-fe30-4518-9366-0fdf65df315b tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:51.901906 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-31dc48c3-fe30-4518-9366-0fdf65df315b tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:51.902337 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-31dc48c3-fe30-4518-9366-0fdf65df315b tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:52.055178 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-31dc48c3-fe30-4518-9366-0fdf65df315b tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:52.063320 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-31dc48c3-fe30-4518-9366-0fdf65df315b tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.174962 Jun 21 16:03:52.064405 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 506/1029] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:51 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:52.644763 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:52.645338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:52.652589 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:52.653047 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:52.653807 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:52.654265 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:52.797944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:52.806296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:52.808029 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:52.809194 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-19fcdee6-6710-49ae-b03d-6ca634ba99bb tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.169248 Jun 21 16:03:52.809752 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 524/1030] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:52 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:53.085545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-283defff-c521-4c08-a809-f7daddc92ae0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:53.086394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-283defff-c521-4c08-a809-f7daddc92ae0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:53.096488 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-283defff-c521-4c08-a809-f7daddc92ae0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:53.096947 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-283defff-c521-4c08-a809-f7daddc92ae0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:53.097696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-283defff-c521-4c08-a809-f7daddc92ae0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:53.098159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-283defff-c521-4c08-a809-f7daddc92ae0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:53.248770 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-283defff-c521-4c08-a809-f7daddc92ae0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:53.257282 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-283defff-c521-4c08-a809-f7daddc92ae0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.178564 Jun 21 16:03:53.257853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 507/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:53 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:53.833495 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:53.834453 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:53.845630 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:53.846621 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:53.847902 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:53.848629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:53.990360 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:53.998734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:54.000222 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:54.001600 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6d3a7701-f957-4dac-973b-10ee5027e79a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.175609 Jun 21 16:03:54.002197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 525/1032] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:53 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:54.279958 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c7e0a441-abd1-4b8c-815e-090b50446212 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:54.280567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c7e0a441-abd1-4b8c-815e-090b50446212 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:54.287933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c7e0a441-abd1-4b8c-815e-090b50446212 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:54.288377 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c7e0a441-abd1-4b8c-815e-090b50446212 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:54.289147 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c7e0a441-abd1-4b8c-815e-090b50446212 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:54.289580 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c7e0a441-abd1-4b8c-815e-090b50446212 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:54.427051 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c7e0a441-abd1-4b8c-815e-090b50446212 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:54.435725 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c7e0a441-abd1-4b8c-815e-090b50446212 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.159781 Jun 21 16:03:54.436295 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 508/1033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:54 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:55.032529 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:55.033522 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:55.043888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:55.044573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:55.045767 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:55.046452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:55.202819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:55.212107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:55.213589 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:55.214789 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8a62c8f4-14cc-416f-9993-f891a404b405 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.188831 Jun 21 16:03:55.215355 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 526/1034] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:55 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:03:55.458009 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b945d0f7-be9e-45e7-9c0f-810e0d179863 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:55.459424 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b945d0f7-be9e-45e7-9c0f-810e0d179863 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:55.469234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b945d0f7-be9e-45e7-9c0f-810e0d179863 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:55.470103 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b945d0f7-be9e-45e7-9c0f-810e0d179863 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:55.471315 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b945d0f7-be9e-45e7-9c0f-810e0d179863 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:55.472030 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b945d0f7-be9e-45e7-9c0f-810e0d179863 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:55.651633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b945d0f7-be9e-45e7-9c0f-810e0d179863 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:55.659951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b945d0f7-be9e-45e7-9c0f-810e0d179863 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.206307 Jun 21 16:03:55.660646 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 509/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:55 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:56.234105 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:56.234708 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:56.241833 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:56.242619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:56.243565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:56.244057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:56.395636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:56.404274 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:56.405753 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:56.406939 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0585ca82-4473-4971-a08d-a8a04f52100c tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.176882 Jun 21 16:03:56.407489 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 527/1036] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:56 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:56.678674 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8da680d1-19fd-4bea-9eb1-3ca57053a82d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:56.679281 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8da680d1-19fd-4bea-9eb1-3ca57053a82d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:56.686189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8da680d1-19fd-4bea-9eb1-3ca57053a82d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:56.686664 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8da680d1-19fd-4bea-9eb1-3ca57053a82d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:56.687423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8da680d1-19fd-4bea-9eb1-3ca57053a82d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:56.687845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8da680d1-19fd-4bea-9eb1-3ca57053a82d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:56.825225 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8da680d1-19fd-4bea-9eb1-3ca57053a82d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:56.833372 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8da680d1-19fd-4bea-9eb1-3ca57053a82d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1313 microversion: 2.1 time: 0.158668 Jun 21 16:03:56.833940 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 510/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:56 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:57.099157 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f651fd6e-91e7-45ad-8dc9-28d6f8125d45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:57.100103 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f651fd6e-91e7-45ad-8dc9-28d6f8125d45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:57.105853 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f651fd6e-91e7-45ad-8dc9-28d6f8125d45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:57.106303 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f651fd6e-91e7-45ad-8dc9-28d6f8125d45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:57.107051 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f651fd6e-91e7-45ad-8dc9-28d6f8125d45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:57.107476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f651fd6e-91e7-45ad-8dc9-28d6f8125d45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:57.133183 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f651fd6e-91e7-45ad-8dc9-28d6f8125d45 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/ips" status: 200 len: 144 microversion: 2.1 time: 0.038383 Jun 21 16:03:57.133868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 528/1038] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 16:03:57 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:57.428738 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:57.429576 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:57.436491 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:57.437053 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:57.438205 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:57.438793 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:57.558479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-4af82863-9c71-4b29-a5b5-92f6a8480c90 req-e3d1967f-9341-4510-bd38-9b9579949d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cea78e9-1d9b-4b08-bbe5-93fadd09e685", "name": "network-vif-plugged", "status": "completed", "tag": "b76d21d6-4f2c-4f99-a9ef-d06b45b48736"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:57.567478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-4af82863-9c71-4b29-a5b5-92f6a8480c90 req-e3d1967f-9341-4510-bd38-9b9579949d27 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:57.568162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-4af82863-9c71-4b29-a5b5-92f6a8480c90 req-e3d1967f-9341-4510-bd38-9b9579949d27 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:57.581912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-4af82863-9c71-4b29-a5b5-92f6a8480c90 req-e3d1967f-9341-4510-bd38-9b9579949d27 service nova] Creating event network-vif-plugged:b76d21d6-4f2c-4f99-a9ef-d06b45b48736 for instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 on hv-cinder-84067 Jun 21 16:03:57.587209 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-4af82863-9c71-4b29-a5b5-92f6a8480c90 req-e3d1967f-9341-4510-bd38-9b9579949d27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Jun 21 16:03:57.587569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:57.588260 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 529/1039] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:03:57.596543 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:57.598106 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:57.599285 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-158ace94-ba0b-4c48-8b63-d653a4794ec2 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.176413 Jun 21 16:03:57.599933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 511/1040] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:57 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:57.851520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-87c3e3dd-dd2d-4548-a977-90520bb37073 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:57.852119 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-87c3e3dd-dd2d-4548-a977-90520bb37073 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:57.858937 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87c3e3dd-dd2d-4548-a977-90520bb37073 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:57.859388 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87c3e3dd-dd2d-4548-a977-90520bb37073 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:57.860166 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87c3e3dd-dd2d-4548-a977-90520bb37073 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:57.860605 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87c3e3dd-dd2d-4548-a977-90520bb37073 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.008295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-87c3e3dd-dd2d-4548-a977-90520bb37073 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:58.016504 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-87c3e3dd-dd2d-4548-a977-90520bb37073 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1496 microversion: 2.1 time: 0.169371 Jun 21 16:03:58.017081 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 530/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:57 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:58.468012 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4a1f5fcb-313b-45a1-aee8-082e9bb4ff39 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "490c7b29-1ccf-4265-b499-f56575b330a4"}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:03:58.470103 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4a1f5fcb-313b-45a1-aee8-082e9bb4ff39 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:58.477721 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a1f5fcb-313b-45a1-aee8-082e9bb4ff39 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:58.478198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a1f5fcb-313b-45a1-aee8-082e9bb4ff39 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.478988 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a1f5fcb-313b-45a1-aee8-082e9bb4ff39 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:58.479423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a1f5fcb-313b-45a1-aee8-082e9bb4ff39 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.528883 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-74b9df3e-5892-4e26-8968-7240a6efcd91 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:58.529582 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-74b9df3e-5892-4e26-8968-7240a6efcd91 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:58.536757 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74b9df3e-5892-4e26-8968-7240a6efcd91 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:58.537271 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74b9df3e-5892-4e26-8968-7240a6efcd91 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.538130 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74b9df3e-5892-4e26-8968-7240a6efcd91 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:58.538779 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-74b9df3e-5892-4e26-8968-7240a6efcd91 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.566642 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-74b9df3e-5892-4e26-8968-7240a6efcd91 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:03:58.652137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-74b9df3e-5892-4e26-8968-7240a6efcd91 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 204 len: 0 microversion: 2.1 time: 0.126537 Jun 21 16:03:58.652734 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 531/1042] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:03:58 2022] DELETE /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 16:03:58.658445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:58.660031 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:58.667561 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:58.667929 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.668694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:58.669152 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.744192 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4a1f5fcb-313b-45a1-aee8-082e9bb4ff39 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279881 Jun 21 16:03:58.744804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 512/1043] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 16:03:58 2022] POST /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:03:58.749792 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9ee385c7-3ac0-41dd-9421-a3750c9effda tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:58.750505 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9ee385c7-3ac0-41dd-9421-a3750c9effda tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:58.757347 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ee385c7-3ac0-41dd-9421-a3750c9effda tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:58.758050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ee385c7-3ac0-41dd-9421-a3750c9effda tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.758854 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ee385c7-3ac0-41dd-9421-a3750c9effda tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:58.759352 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9ee385c7-3ac0-41dd-9421-a3750c9effda tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:58.843810 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:58.852679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:58.854317 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:58.855496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3e2b92f6-dd3b-4aa9-9329-0bbbdd4214dc tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.201475 Jun 21 16:03:58.856033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 532/1044] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:58 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:03:58.908959 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9ee385c7-3ac0-41dd-9421-a3750c9effda tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:03:58.916962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9ee385c7-3ac0-41dd-9421-a3750c9effda tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1502 microversion: 2.1 time: 0.171050 Jun 21 16:03:58.917643 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 513/1045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:58 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:03:59.875924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:59.876509 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:59.883898 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:59.884345 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:59.885114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:59.885548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:59.889747 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:59.935601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d1cb299f-ac72-490e-a89f-36e07cb3af3c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:03:59.936200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d1cb299f-ac72-490e-a89f-36e07cb3af3c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:03:59.942719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1cb299f-ac72-490e-a89f-36e07cb3af3c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:59.943163 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1cb299f-ac72-490e-a89f-36e07cb3af3c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:03:59.943927 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1cb299f-ac72-490e-a89f-36e07cb3af3c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:03:59.944355 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1cb299f-ac72-490e-a89f-36e07cb3af3c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:00.080644 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:00.089325 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:00.090989 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:00.092310 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-aa113f11-5be1-4785-8558-17fbe59e66ff tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.220394 Jun 21 16:04:00.092945 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 533/1046] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:03:59 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:04:00.109962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d1cb299f-ac72-490e-a89f-36e07cb3af3c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:00.117791 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d1cb299f-ac72-490e-a89f-36e07cb3af3c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1502 microversion: 2.1 time: 0.186116 Jun 21 16:04:00.118350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 514/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:03:59 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:01.111501 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:01.112303 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:01.119874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:01.120540 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:01.121749 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:01.122876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:01.146402 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8e2f859f-3a94-46a7-bf1f-f7c686682e6c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:01.147857 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8e2f859f-3a94-46a7-bf1f-f7c686682e6c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:01.174516 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8e2f859f-3a94-46a7-bf1f-f7c686682e6c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:01.175335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8e2f859f-3a94-46a7-bf1f-f7c686682e6c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:01.176886 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8e2f859f-3a94-46a7-bf1f-f7c686682e6c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:01.177633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8e2f859f-3a94-46a7-bf1f-f7c686682e6c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:01.251141 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8e2f859f-3a94-46a7-bf1f-f7c686682e6c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:01.259309 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8e2f859f-3a94-46a7-bf1f-f7c686682e6c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 200 len: 1460 microversion: 2.1 time: 0.127580 Jun 21 16:04:01.259737 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 515/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:01 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 1460 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:01.264326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-79c64752-0c7e-4a1d-833a-ca015fed6a84 req-efba4126-fb5d-49e5-84bc-54729185890c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2401b1e9-284c-4a8d-b932-beb815806a32", "name": "network-vif-deleted", "tag": "a2bb44a5-317c-4990-a31c-8f74b6120718"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:01.273198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-79c64752-0c7e-4a1d-833a-ca015fed6a84 req-efba4126-fb5d-49e5-84bc-54729185890c service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:01.273875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-79c64752-0c7e-4a1d-833a-ca015fed6a84 req-efba4126-fb5d-49e5-84bc-54729185890c service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:01.285680 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-79c64752-0c7e-4a1d-833a-ca015fed6a84 req-efba4126-fb5d-49e5-84bc-54729185890c service nova] Creating event network-vif-deleted:a2bb44a5-317c-4990-a31c-8f74b6120718 for instance 2401b1e9-284c-4a8d-b932-beb815806a32 on hv-cinder-84067 Jun 21 16:04:01.290847 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-79c64752-0c7e-4a1d-833a-ca015fed6a84 req-efba4126-fb5d-49e5-84bc-54729185890c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030008 Jun 21 16:04:01.291622 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 516/1049] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:01.313188 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:01.322025 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:01.323512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:01.324681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d4ab024d-466e-43ef-bac2-b274e4bb8862 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1729 microversion: 2.20 time: 0.217848 Jun 21 16:04:01.325210 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 534/1050] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:04:01 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:04:02.277726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:02.278472 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: 2401b1e9-284c-4a8d-b932-beb815806a32] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:02.285806 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:02.286287 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:02.287041 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:02.287463 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:02.301311 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] HTTP exception thrown: Instance 2401b1e9-284c-4a8d-b932-beb815806a32 could not be found. Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Request method failure captured: Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 HTTP/1.1 Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisevMAsVjzeKaT_dQ5fzpwu_jP9OrONXJDlLu8-QYmwM6CSjWjqX4D3IBfWBk2ioBI1WlSF6nuqn-tTq3dG_iIHeEkfrGR19N_4p5HmWY1JTj82-iHBMLY3yihB3wjpvUcMyBWmk_QLka3iyLzpw0N-_eVlopLwXuUueHP5MKgI8iNVY Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 69b62d21e3d54a5592e26594c6483188 Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesActionsTest-61423258 Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:04:02.302990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69b62d21e3d54a5592e26594c6483188"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69b62d21e3d54a5592e26594c6483188"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69b62d21e3d54a5592e26594c6483188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69b62d21e3d54a5592e26594c6483188", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesActionsTest-61423258 Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 69b62d21e3d54a5592e26594c6483188 Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesActionsTest-61423258 Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesActionsTest-61423258-project Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 57bdca8c562a42a3af75f4d7d36bdecc Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesActionsTest-61423258-project Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 2401b1e9-284c-4a8d-b932-beb815806a32 could not be found. Jun 21 16:04:02.304545 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '2401b1e9-284c-4a8d-b932-beb815806a32'} Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2401b1e9-284c-4a8d-b932-beb815806a32 could not be found. Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:02.305392 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2401b1e9-284c-4a8d-b932-beb815806a32 could not be found. Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2401b1e9-284c-4a8d-b932-beb815806a32 could not be found. Jun 21 16:04:02.306709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:02.308124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Returning 404 to user: Instance 2401b1e9-284c-4a8d-b932-beb815806a32 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:02.308124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-85729a06-9164-4604-b3e4-97feb99e0ca7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32" status: 404 len: 111 microversion: 2.1 time: 0.031622 Jun 21 16:04:02.308124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 517/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:02 2022] GET /compute/v2.1/servers/2401b1e9-284c-4a8d-b932-beb815806a32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:04:02.343648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:02.344257 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:02.351443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:02.351922 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:02.352695 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:02.353126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:02.356018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1040028311", "imageRef": "519e6b98-1a30-4541-85ef-313f056aeeac", "flavorRef": "452", "networks": [{"uuid": "05ce3fb1-9c19-4c59-8785-e2b2e38b7e34"}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:02.415641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] validate_networks() for [('05ce3fb1-9c19-4c59-8785-e2b2e38b7e34', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:04:02.602368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:02.610861 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:02.612352 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:02.613918 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d1941018-d84c-4cee-b88e-78f5ab32a6fe tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1716 microversion: 2.20 time: 0.274089 Jun 21 16:04:02.614688 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 535/1052] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:04:02 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1716 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:04:02.888979 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:04:02.889410 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:04:02.889916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:04:02.890335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:04:02.890730 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:04:02.900713 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:02.901182 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:02.902081 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:02.902507 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:02.919803 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Getting quotas for project 69b62d21e3d54a5592e26594c6483188. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:04:02.923929 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Getting quotas for user 57bdca8c562a42a3af75f4d7d36bdecc and project 69b62d21e3d54a5592e26594c6483188. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:04:02.935648 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:04:02.938177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='519e6b98-1a30-4541-85ef-313f056aeeac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:04:02.987195 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-54cb50d3-6bbb-4700-98d9-28f0374ff2ed tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634566 Jun 21 16:04:02.987354 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 518/1053] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 16:04:02.997740 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a37d4523-bde9-4030-a400-cb336197e2c9 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:02.998540 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a37d4523-bde9-4030-a400-cb336197e2c9 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:03.057363 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a37d4523-bde9-4030-a400-cb336197e2c9 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:03.064053 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a37d4523-bde9-4030-a400-cb336197e2c9 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1214 microversion: 2.1 time: 0.070262 Jun 21 16:04:03.064623 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 536/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:02 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:04:04.082795 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-82b5d124-0290-4c9c-91d2-7acb4d624d84 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:04.083421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-82b5d124-0290-4c9c-91d2-7acb4d624d84 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:04.090528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-82b5d124-0290-4c9c-91d2-7acb4d624d84 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:04.090980 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-82b5d124-0290-4c9c-91d2-7acb4d624d84 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:04.091733 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-82b5d124-0290-4c9c-91d2-7acb4d624d84 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:04.092159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-82b5d124-0290-4c9c-91d2-7acb4d624d84 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:04.203389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-82b5d124-0290-4c9c-91d2-7acb4d624d84 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:04.212428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-82b5d124-0290-4c9c-91d2-7acb4d624d84 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1284 microversion: 2.1 time: 0.134430 Jun 21 16:04:04.213000 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 519/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:04 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:05.230729 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cd2aed8f-9fd8-4740-ac3a-d54458a9bd7a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:05.231333 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cd2aed8f-9fd8-4740-ac3a-d54458a9bd7a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:05.238836 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd2aed8f-9fd8-4740-ac3a-d54458a9bd7a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:05.239344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd2aed8f-9fd8-4740-ac3a-d54458a9bd7a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:05.240318 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd2aed8f-9fd8-4740-ac3a-d54458a9bd7a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:05.240937 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cd2aed8f-9fd8-4740-ac3a-d54458a9bd7a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:05.639085 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cd2aed8f-9fd8-4740-ac3a-d54458a9bd7a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:05.647277 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cd2aed8f-9fd8-4740-ac3a-d54458a9bd7a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1314 microversion: 2.1 time: 0.420438 Jun 21 16:04:05.657228 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 537/1056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:05 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:05.758202 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-59aec01e-bff0-4082-a422-a8ba3a390591 req-91a1cf07-8164-48ca-bfe9-6cc5753ce27a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf0e9a8-b08f-4b0f-9a77-45a159e604ca", "tag": "4398658f-51e9-43a8-b54d-6941d5070085"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:05.766920 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-59aec01e-bff0-4082-a422-a8ba3a390591 req-91a1cf07-8164-48ca-bfe9-6cc5753ce27a service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:05.767350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-59aec01e-bff0-4082-a422-a8ba3a390591 req-91a1cf07-8164-48ca-bfe9-6cc5753ce27a service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:05.794314 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-59aec01e-bff0-4082-a422-a8ba3a390591 req-91a1cf07-8164-48ca-bfe9-6cc5753ce27a service nova] Creating event network-changed:4398658f-51e9-43a8-b54d-6941d5070085 for instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca on hv-cinder-84067 Jun 21 16:04:05.800247 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-59aec01e-bff0-4082-a422-a8ba3a390591 req-91a1cf07-8164-48ca-bfe9-6cc5753ce27a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046853 Jun 21 16:04:05.801479 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 520/1057] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:06.668534 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a46a27c4-74e3-4984-86ce-c9322b8c14ff tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:06.669196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a46a27c4-74e3-4984-86ce-c9322b8c14ff tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:06.679217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a46a27c4-74e3-4984-86ce-c9322b8c14ff tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:06.679657 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a46a27c4-74e3-4984-86ce-c9322b8c14ff tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:06.680411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a46a27c4-74e3-4984-86ce-c9322b8c14ff tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:06.680834 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a46a27c4-74e3-4984-86ce-c9322b8c14ff tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:06.827437 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a46a27c4-74e3-4984-86ce-c9322b8c14ff tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:06.836496 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a46a27c4-74e3-4984-86ce-c9322b8c14ff tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1314 microversion: 2.1 time: 0.174323 Jun 21 16:04:06.837088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 538/1058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:06 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:07.859080 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f1fc1ddc-28fd-4d70-9d45-52755bde026c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:07.860115 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f1fc1ddc-28fd-4d70-9d45-52755bde026c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:07.863108 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:07.875330 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f1fc1ddc-28fd-4d70-9d45-52755bde026c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:07.875996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f1fc1ddc-28fd-4d70-9d45-52755bde026c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:07.877109 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f1fc1ddc-28fd-4d70-9d45-52755bde026c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:07.877845 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f1fc1ddc-28fd-4d70-9d45-52755bde026c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:08.032301 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f1fc1ddc-28fd-4d70-9d45-52755bde026c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:08.041831 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f1fc1ddc-28fd-4d70-9d45-52755bde026c tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1314 microversion: 2.1 time: 0.190252 Jun 21 16:04:08.042396 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 521/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:07 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:09.060003 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8a2376bc-507a-45bd-a0fa-3928043fd7ab tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:09.060623 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8a2376bc-507a-45bd-a0fa-3928043fd7ab tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:09.063323 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:09.070477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a2376bc-507a-45bd-a0fa-3928043fd7ab tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:09.070957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a2376bc-507a-45bd-a0fa-3928043fd7ab tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:09.071842 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a2376bc-507a-45bd-a0fa-3928043fd7ab tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:09.072304 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a2376bc-507a-45bd-a0fa-3928043fd7ab tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:09.223388 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8a2376bc-507a-45bd-a0fa-3928043fd7ab tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:09.231368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8a2376bc-507a-45bd-a0fa-3928043fd7ab tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1314 microversion: 2.1 time: 0.175680 Jun 21 16:04:09.231963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 539/1060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:09 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:10.250062 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7735a2f6-f6aa-4a94-909f-db7b96612bd7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:10.251313 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7735a2f6-f6aa-4a94-909f-db7b96612bd7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:10.258188 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7735a2f6-f6aa-4a94-909f-db7b96612bd7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:10.260855 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7735a2f6-f6aa-4a94-909f-db7b96612bd7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:10.261690 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7735a2f6-f6aa-4a94-909f-db7b96612bd7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:10.262934 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7735a2f6-f6aa-4a94-909f-db7b96612bd7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:10.479135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7735a2f6-f6aa-4a94-909f-db7b96612bd7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:10.487979 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7735a2f6-f6aa-4a94-909f-db7b96612bd7 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1314 microversion: 2.1 time: 0.243047 Jun 21 16:04:10.488849 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 522/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:10 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:10.559392 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-aae32ea2-65cc-4316-aee2-74d4afc64819 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:10.560437 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-aae32ea2-65cc-4316-aee2-74d4afc64819 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:10.567560 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aae32ea2-65cc-4316-aee2-74d4afc64819 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:10.568144 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aae32ea2-65cc-4316-aee2-74d4afc64819 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:10.568909 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aae32ea2-65cc-4316-aee2-74d4afc64819 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:10.569471 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aae32ea2-65cc-4316-aee2-74d4afc64819 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:10.601087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-aae32ea2-65cc-4316-aee2-74d4afc64819 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Jun 21 16:04:10.601087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 540/1062] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:04:10 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:10.611481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c31fecbe-f508-4208-a411-e8fe700ce9eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:10.611972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c31fecbe-f508-4208-a411-e8fe700ce9eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:10.618929 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c31fecbe-f508-4208-a411-e8fe700ce9eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:10.619379 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c31fecbe-f508-4208-a411-e8fe700ce9eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:10.620138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c31fecbe-f508-4208-a411-e8fe700ce9eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:10.620547 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c31fecbe-f508-4208-a411-e8fe700ce9eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:10.637627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:10.652123 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c31fecbe-f508-4208-a411-e8fe700ce9eb tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/490c7b29-1ccf-4265-b499-f56575b330a4" status: 200 len: 194 microversion: 2.1 time: 0.044698 Jun 21 16:04:10.652724 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 523/1063] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Jun 21 16:04:10 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/490c7b29-1ccf-4265-b499-f56575b330a4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:11.506683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e21fd3a9-fff4-4ab7-a15e-d877bc56844e tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:11.507209 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e21fd3a9-fff4-4ab7-a15e-d877bc56844e tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:11.513803 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e21fd3a9-fff4-4ab7-a15e-d877bc56844e tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:11.514330 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e21fd3a9-fff4-4ab7-a15e-d877bc56844e tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:11.515099 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e21fd3a9-fff4-4ab7-a15e-d877bc56844e tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:11.515533 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e21fd3a9-fff4-4ab7-a15e-d877bc56844e tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:11.652167 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e21fd3a9-fff4-4ab7-a15e-d877bc56844e tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:11.656332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-0f123afc-9dfa-4712-a758-face3b5f7c92 req-62e1ee57-7d30-4a1d-bd09-d2e435de5ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf0e9a8-b08f-4b0f-9a77-45a159e604ca", "name": "network-vif-plugged", "status": "completed", "tag": "4398658f-51e9-43a8-b54d-6941d5070085"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:11.660059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e21fd3a9-fff4-4ab7-a15e-d877bc56844e tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1314 microversion: 2.1 time: 0.158152 Jun 21 16:04:11.660639 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 541/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:11 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:11.666832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-0f123afc-9dfa-4712-a758-face3b5f7c92 req-62e1ee57-7d30-4a1d-bd09-d2e435de5ce8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:11.667276 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-0f123afc-9dfa-4712-a758-face3b5f7c92 req-62e1ee57-7d30-4a1d-bd09-d2e435de5ce8 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:11.680040 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-0f123afc-9dfa-4712-a758-face3b5f7c92 req-62e1ee57-7d30-4a1d-bd09-d2e435de5ce8 service nova] Creating event network-vif-plugged:4398658f-51e9-43a8-b54d-6941d5070085 for instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca on hv-cinder-84067 Jun 21 16:04:11.685028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-0f123afc-9dfa-4712-a758-face3b5f7c92 req-62e1ee57-7d30-4a1d-bd09-d2e435de5ce8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034163 Jun 21 16:04:11.685622 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 524/1065] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:12.018547 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-46f4ee20-e73b-4cc3-b38d-163d42f37d37 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d4e4412-3ec3-4c4b-947d-8c9e1c9b4034"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:12.019680 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-46f4ee20-e73b-4cc3-b38d-163d42f37d37 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:12.026801 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-46f4ee20-e73b-4cc3-b38d-163d42f37d37 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:12.027251 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-46f4ee20-e73b-4cc3-b38d-163d42f37d37 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:12.028021 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-46f4ee20-e73b-4cc3-b38d-163d42f37d37 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:12.028450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-46f4ee20-e73b-4cc3-b38d-163d42f37d37 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:12.394723 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-46f4ee20-e73b-4cc3-b38d-163d42f37d37 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "POST /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380051 Jun 21 16:04:12.395374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 542/1066] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 16:04:12 2022] POST /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:12.680246 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3633c2af-c3d2-4255-82fb-38b698696e5f tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:12.680794 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3633c2af-c3d2-4255-82fb-38b698696e5f tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:12.687907 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3633c2af-c3d2-4255-82fb-38b698696e5f tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:12.688344 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3633c2af-c3d2-4255-82fb-38b698696e5f tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:12.689091 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3633c2af-c3d2-4255-82fb-38b698696e5f tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:12.689512 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3633c2af-c3d2-4255-82fb-38b698696e5f tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:12.830969 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3633c2af-c3d2-4255-82fb-38b698696e5f tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:12.840837 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3633c2af-c3d2-4255-82fb-38b698696e5f tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1314 microversion: 2.1 time: 0.166036 Jun 21 16:04:12.841404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 525/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:12 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:13.857876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:13.864894 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-514bd8a4-8b18-4ac4-8ba1-d98bc0d5aa76 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:13.865934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-514bd8a4-8b18-4ac4-8ba1-d98bc0d5aa76 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:13.875722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-514bd8a4-8b18-4ac4-8ba1-d98bc0d5aa76 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:13.876363 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-514bd8a4-8b18-4ac4-8ba1-d98bc0d5aa76 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:13.877479 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-514bd8a4-8b18-4ac4-8ba1-d98bc0d5aa76 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:13.878140 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-514bd8a4-8b18-4ac4-8ba1-d98bc0d5aa76 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:14.019081 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-514bd8a4-8b18-4ac4-8ba1-d98bc0d5aa76 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:14.029628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-514bd8a4-8b18-4ac4-8ba1-d98bc0d5aa76 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1497 microversion: 2.1 time: 0.174231 Jun 21 16:04:14.030422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 543/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:13 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:14.477716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-130cc7ff-5b09-41ce-bdaa-043f6826a4d0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:14.478318 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-130cc7ff-5b09-41ce-bdaa-043f6826a4d0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:14.480186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:14.480840 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=6 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:14.487496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-130cc7ff-5b09-41ce-bdaa-043f6826a4d0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:14.487951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-130cc7ff-5b09-41ce-bdaa-043f6826a4d0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:14.488745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-130cc7ff-5b09-41ce-bdaa-043f6826a4d0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:14.489173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-130cc7ff-5b09-41ce-bdaa-043f6826a4d0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:14.517387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-130cc7ff-5b09-41ce-bdaa-043f6826a4d0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:04:14.596713 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-130cc7ff-5b09-41ce-bdaa-043f6826a4d0 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 204 len: 0 microversion: 2.1 time: 0.122614 Jun 21 16:04:14.597627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 526/1069] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:04:14 2022] DELETE /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:04:14.605954 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dc76c70f-82a1-4e84-9aac-9476a0a4dad6 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:14.606563 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dc76c70f-82a1-4e84-9aac-9476a0a4dad6 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:14.613418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dc76c70f-82a1-4e84-9aac-9476a0a4dad6 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:14.613884 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dc76c70f-82a1-4e84-9aac-9476a0a4dad6 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:14.614684 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dc76c70f-82a1-4e84-9aac-9476a0a4dad6 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:14.615107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dc76c70f-82a1-4e84-9aac-9476a0a4dad6 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:14.748262 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dc76c70f-82a1-4e84-9aac-9476a0a4dad6 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:14.756164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dc76c70f-82a1-4e84-9aac-9476a0a4dad6 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1503 microversion: 2.1 time: 0.154136 Jun 21 16:04:14.756738 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 544/1070] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:14 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:15.779065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0c1ee976-aa3b-4b36-8985-8a488e9639e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:15.779783 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0c1ee976-aa3b-4b36-8985-8a488e9639e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:15.786741 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c1ee976-aa3b-4b36-8985-8a488e9639e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:15.787190 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c1ee976-aa3b-4b36-8985-8a488e9639e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:15.788049 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c1ee976-aa3b-4b36-8985-8a488e9639e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:15.788478 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0c1ee976-aa3b-4b36-8985-8a488e9639e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:15.936462 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0c1ee976-aa3b-4b36-8985-8a488e9639e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:15.946526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0c1ee976-aa3b-4b36-8985-8a488e9639e5 tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1503 microversion: 2.1 time: 0.171798 Jun 21 16:04:15.947090 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 527/1071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:15 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:16.664827 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-fb7a54d4-cf12-4557-be64-b0817744a5b3 req-1d9af056-b291-4831-97f8-80c05ab4fda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf0e9a8-b08f-4b0f-9a77-45a159e604ca", "name": "network-vif-deleted", "tag": "4398658f-51e9-43a8-b54d-6941d5070085"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:16.674178 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-fb7a54d4-cf12-4557-be64-b0817744a5b3 req-1d9af056-b291-4831-97f8-80c05ab4fda7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:16.674531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-fb7a54d4-cf12-4557-be64-b0817744a5b3 req-1d9af056-b291-4831-97f8-80c05ab4fda7 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:16.686025 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-fb7a54d4-cf12-4557-be64-b0817744a5b3 req-1d9af056-b291-4831-97f8-80c05ab4fda7 service nova] Creating event network-vif-deleted:4398658f-51e9-43a8-b54d-6941d5070085 for instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca on hv-cinder-84067 Jun 21 16:04:16.691275 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-fb7a54d4-cf12-4557-be64-b0817744a5b3 req-1d9af056-b291-4831-97f8-80c05ab4fda7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030771 Jun 21 16:04:16.691874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 545/1072] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:16.964771 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:16.965332 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:16.972350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:16.972790 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:16.973548 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:16.974022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:17.005888 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:17.006324 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:17.006972 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lazy-loading 'fault' on Instance uuid fcf0e9a8-b08f-4b0f-9a77-45a159e604ca {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:04:17.051919 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdca8c562a42a3af75f4d7d36bdecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b62d21e3d54a5592e26594c6483188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:17.060149 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e3c0de2e-880c-4f58-b55d-56a74d39ec7d tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 200 len: 1304 microversion: 2.1 time: 0.099177 Jun 21 16:04:17.060718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 528/1073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:16 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:18.079531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:18.080286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] [instance: fcf0e9a8-b08f-4b0f-9a77-45a159e604ca] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:18.089096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:18.089582 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:18.090389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:18.090825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:18.105739 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] HTTP exception thrown: Instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca could not be found. Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Request method failure captured: Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca HTTP/1.1 Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisevMAsVjzeKaT_dQ5fzpwu_jP9OrONXJDlLu8-QYmwM6CSjWjqX4D3IBfWBk2ioBI1WlSF6nuqn-tTq3dG_iIHeEkfrGR19N_4p5HmWY1JTj82-iHBMLY3yihB3wjpvUcMyBWmk_QLka3iyLzpw0N-_eVlopLwXuUueHP5MKgI8iNVY Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 69b62d21e3d54a5592e26594c6483188 Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-VolumesActionsTest-61423258 Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:04:18.107405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69b62d21e3d54a5592e26594c6483188"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69b62d21e3d54a5592e26594c6483188"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69b62d21e3d54a5592e26594c6483188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69b62d21e3d54a5592e26594c6483188", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-VolumesActionsTest-61423258 Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 69b62d21e3d54a5592e26594c6483188 Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-VolumesActionsTest-61423258 Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-VolumesActionsTest-61423258-project Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 57bdca8c562a42a3af75f4d7d36bdecc Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-VolumesActionsTest-61423258-project Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca could not be found. Jun 21 16:04:18.108858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'fcf0e9a8-b08f-4b0f-9a77-45a159e604ca'} Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca could not be found. Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:18.109614 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca could not be found. Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca could not be found. Jun 21 16:04:18.110990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:18.112411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] Returning 404 to user: Instance fcf0e9a8-b08f-4b0f-9a77-45a159e604ca could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:18.112411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b7ad9172-d10f-4862-89e1-ad18ed59dd8a tempest-VolumesActionsTest-61423258 tempest-VolumesActionsTest-61423258-project] 10.222.0.52 "GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca" status: 404 len: 111 microversion: 2.1 time: 0.034411 Jun 21 16:04:18.112411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 546/1074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:18 2022] GET /compute/v2.1/servers/fcf0e9a8-b08f-4b0f-9a77-45a159e604ca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:04:25.229070 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-74069441-3b8d-49d0-adf2-565f440f6fab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:25.230024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-74069441-3b8d-49d0-adf2-565f440f6fab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:25.236991 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-74069441-3b8d-49d0-adf2-565f440f6fab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:25.237674 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-74069441-3b8d-49d0-adf2-565f440f6fab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:25.238634 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-74069441-3b8d-49d0-adf2-565f440f6fab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:25.239220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-74069441-3b8d-49d0-adf2-565f440f6fab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:25.283252 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-74069441-3b8d-49d0-adf2-565f440f6fab tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057972 Jun 21 16:04:25.283879 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 529/1075] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:04:25 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:25.424275 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-719c651a-f7c5-472c-b3b4-60f1f6171314 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:25.425416 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-719c651a-f7c5-472c-b3b4-60f1f6171314 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:25.434597 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-719c651a-f7c5-472c-b3b4-60f1f6171314 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:25.435647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-719c651a-f7c5-472c-b3b4-60f1f6171314 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:25.436998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-719c651a-f7c5-472c-b3b4-60f1f6171314 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:25.437862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-719c651a-f7c5-472c-b3b4-60f1f6171314 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:25.481283 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-719c651a-f7c5-472c-b3b4-60f1f6171314 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/490c7b29-1ccf-4265-b499-f56575b330a4" status: 200 len: 194 microversion: 2.1 time: 0.061323 Jun 21 16:04:25.482240 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 547/1076] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Jun 21 16:04:25 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/490c7b29-1ccf-4265-b499-f56575b330a4 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:25.493352 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-55998345-7ab7-4921-ba40-cdfbe51c3ea9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:25.494306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-55998345-7ab7-4921-ba40-cdfbe51c3ea9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:25.501733 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-55998345-7ab7-4921-ba40-cdfbe51c3ea9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:25.502234 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-55998345-7ab7-4921-ba40-cdfbe51c3ea9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:25.503024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-55998345-7ab7-4921-ba40-cdfbe51c3ea9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:25.503471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-55998345-7ab7-4921-ba40-cdfbe51c3ea9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:25.614247 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-55998345-7ab7-4921-ba40-cdfbe51c3ea9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lazy-loading 'services' on Instance uuid fb680b25-924b-466f-bdbf-296cb1945f93 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:04:25.719947 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-55998345-7ab7-4921-ba40-cdfbe51c3ea9 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/490c7b29-1ccf-4265-b499-f56575b330a4" status: 202 len: 0 microversion: 2.1 time: 0.231395 Jun 21 16:04:25.721006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 530/1077] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:04:25 2022] DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/490c7b29-1ccf-4265-b499-f56575b330a4 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:04:27.950283 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dedae7dc-b01a-4214-8ba1-1bd99a78c694 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:27.951464 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dedae7dc-b01a-4214-8ba1-1bd99a78c694 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:27.958942 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dedae7dc-b01a-4214-8ba1-1bd99a78c694 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:27.959511 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dedae7dc-b01a-4214-8ba1-1bd99a78c694 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:27.960706 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dedae7dc-b01a-4214-8ba1-1bd99a78c694 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:27.961506 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dedae7dc-b01a-4214-8ba1-1bd99a78c694 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:27.998999 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dedae7dc-b01a-4214-8ba1-1bd99a78c694 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/3d4e4412-3ec3-4c4b-947d-8c9e1c9b4034" status: 200 len: 194 microversion: 2.1 time: 0.053990 Jun 21 16:04:27.999745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 548/1078] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Jun 21 16:04:27 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/3d4e4412-3ec3-4c4b-947d-8c9e1c9b4034 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:28.012559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-90c32d1b-8933-430c-940b-1f00fb3aefa6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:28.013420 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-90c32d1b-8933-430c-940b-1f00fb3aefa6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:28.026028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90c32d1b-8933-430c-940b-1f00fb3aefa6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:28.026863 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90c32d1b-8933-430c-940b-1f00fb3aefa6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:28.027911 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90c32d1b-8933-430c-940b-1f00fb3aefa6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:28.028456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-90c32d1b-8933-430c-940b-1f00fb3aefa6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:28.155426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-90c32d1b-8933-430c-940b-1f00fb3aefa6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lazy-loading 'services' on Instance uuid fb680b25-924b-466f-bdbf-296cb1945f93 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:04:28.259830 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-90c32d1b-8933-430c-940b-1f00fb3aefa6 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/3d4e4412-3ec3-4c4b-947d-8c9e1c9b4034" status: 202 len: 0 microversion: 2.1 time: 0.252731 Jun 21 16:04:28.261252 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 531/1079] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:04:28 2022] DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments/3d4e4412-3ec3-4c4b-947d-8c9e1c9b4034 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:04:29.465508 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f5001163-c232-46e2-9a28-d4624cb67b9b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:29.467177 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f5001163-c232-46e2-9a28-d4624cb67b9b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:29.474370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f5001163-c232-46e2-9a28-d4624cb67b9b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:29.475035 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f5001163-c232-46e2-9a28-d4624cb67b9b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:29.475981 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f5001163-c232-46e2-9a28-d4624cb67b9b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:29.476595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f5001163-c232-46e2-9a28-d4624cb67b9b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:29.508692 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f5001163-c232-46e2-9a28-d4624cb67b9b tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048125 Jun 21 16:04:29.509896 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 549/1080] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:04:29 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:04:29.627705 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1a751505-6094-4516-b1e2-a23237b0787f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:29.628757 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1a751505-6094-4516-b1e2-a23237b0787f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:29.635479 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a751505-6094-4516-b1e2-a23237b0787f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:29.635922 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a751505-6094-4516-b1e2-a23237b0787f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:29.636692 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a751505-6094-4516-b1e2-a23237b0787f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:29.637118 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a751505-6094-4516-b1e2-a23237b0787f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:29.670431 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1a751505-6094-4516-b1e2-a23237b0787f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047475 Jun 21 16:04:29.671338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 532/1081] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:04:29 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:04:29.735934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ab83eaa0-c011-483b-9bd2-5a547188768e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:29.736515 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ab83eaa0-c011-483b-9bd2-5a547188768e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:29.744361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab83eaa0-c011-483b-9bd2-5a547188768e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:29.744912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab83eaa0-c011-483b-9bd2-5a547188768e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:29.745851 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab83eaa0-c011-483b-9bd2-5a547188768e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:29.746435 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab83eaa0-c011-483b-9bd2-5a547188768e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:29.776992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ab83eaa0-c011-483b-9bd2-5a547188768e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:04:29.780586 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:29.870704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ab83eaa0-c011-483b-9bd2-5a547188768e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 204 len: 0 microversion: 2.1 time: 0.138198 Jun 21 16:04:29.874793 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 550/1082] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:04:29 2022] DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:04:29.880121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b80f0702-e842-4d03-9255-741d8fdad886 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:29.881316 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b80f0702-e842-4d03-9255-741d8fdad886 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:29.887890 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b80f0702-e842-4d03-9255-741d8fdad886 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:29.888411 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b80f0702-e842-4d03-9255-741d8fdad886 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:29.889240 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b80f0702-e842-4d03-9255-741d8fdad886 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:29.889733 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b80f0702-e842-4d03-9255-741d8fdad886 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:30.071302 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b80f0702-e842-4d03-9255-741d8fdad886 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:30.080788 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b80f0702-e842-4d03-9255-741d8fdad886 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1673 microversion: 2.1 time: 0.204483 Jun 21 16:04:30.081804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 533/1083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:29 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:31.099905 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-db883508-8afd-4f8e-9815-24155d715850 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:31.101473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-db883508-8afd-4f8e-9815-24155d715850 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:31.108851 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-db883508-8afd-4f8e-9815-24155d715850 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:31.109278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-db883508-8afd-4f8e-9815-24155d715850 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:31.110064 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-db883508-8afd-4f8e-9815-24155d715850 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:31.110695 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-db883508-8afd-4f8e-9815-24155d715850 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:31.257380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-db883508-8afd-4f8e-9815-24155d715850 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:31.267512 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-db883508-8afd-4f8e-9815-24155d715850 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1673 microversion: 2.1 time: 0.171842 Jun 21 16:04:31.268331 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 551/1084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:31 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:32.285078 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0657f44b-058b-4229-8b6b-521d8f406c55 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:32.286461 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0657f44b-058b-4229-8b6b-521d8f406c55 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:32.293887 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0657f44b-058b-4229-8b6b-521d8f406c55 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:32.294439 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0657f44b-058b-4229-8b6b-521d8f406c55 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:32.295406 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0657f44b-058b-4229-8b6b-521d8f406c55 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:32.295899 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0657f44b-058b-4229-8b6b-521d8f406c55 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:32.439548 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0657f44b-058b-4229-8b6b-521d8f406c55 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:32.447834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0657f44b-058b-4229-8b6b-521d8f406c55 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1673 microversion: 2.1 time: 0.166814 Jun 21 16:04:32.458107 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 534/1085] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:32 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:33.469490 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-707add40-1e86-4bfe-990e-64b77ce66fb2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:33.471301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-707add40-1e86-4bfe-990e-64b77ce66fb2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:33.510187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-707add40-1e86-4bfe-990e-64b77ce66fb2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:33.510811 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-707add40-1e86-4bfe-990e-64b77ce66fb2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:33.511881 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-707add40-1e86-4bfe-990e-64b77ce66fb2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:33.512537 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-707add40-1e86-4bfe-990e-64b77ce66fb2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:33.644070 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-707add40-1e86-4bfe-990e-64b77ce66fb2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5a48626c934dc2aa4f24002970b6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f35c94371b44c6936b1e713a398f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:04:33.672708 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-707add40-1e86-4bfe-990e-64b77ce66fb2 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 200 len: 1605 microversion: 2.1 time: 0.209871 Jun 21 16:04:33.674731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 552/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:33 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:04:33.857139 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-93ed7a62-a3ea-4e4c-81a5-1558ea261516 req-0f7501ef-7d65-407a-b241-d5ed565a46d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb680b25-924b-466f-bdbf-296cb1945f93", "name": "network-vif-deleted", "tag": "acee8f33-cfa6-4297-bcd4-5a348de1fe92"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:33.867786 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-93ed7a62-a3ea-4e4c-81a5-1558ea261516 req-0f7501ef-7d65-407a-b241-d5ed565a46d4 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:33.868727 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-93ed7a62-a3ea-4e4c-81a5-1558ea261516 req-0f7501ef-7d65-407a-b241-d5ed565a46d4 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:33.881439 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-93ed7a62-a3ea-4e4c-81a5-1558ea261516 req-0f7501ef-7d65-407a-b241-d5ed565a46d4 service nova] Creating event network-vif-deleted:acee8f33-cfa6-4297-bcd4-5a348de1fe92 for instance fb680b25-924b-466f-bdbf-296cb1945f93 on hv-cinder-84067 Jun 21 16:04:33.894189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-93ed7a62-a3ea-4e4c-81a5-1558ea261516 req-0f7501ef-7d65-407a-b241-d5ed565a46d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041204 Jun 21 16:04:33.902290 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 535/1087] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:04:34.697457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:34.698091 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:34.706704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:34.707541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:34.708643 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:34.709326 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:34.726444 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] HTTP exception thrown: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Request method failure captured: Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 HTTP/1.1 Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemEHj1PQfeyonPC5JhAMnvCJaBYPt7Bxh2KpgSGT-0GJo-Ki13Vu06q1KXcGThnz8KWiwakrA7uN6z2Bvbo08JEdQxNCvnUIpo7-zEwmTIhnhAjuYn1qgfVH6wDk_yWs3TZ4V1wkm_ndbz9GWwwIsXG9oc7TJObZ-EaDj9taalbNL0 Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:04:34.728400 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f35c94371b44c6936b1e713a398f1c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: fa5a48626c934dc2aa4f24002970b6d5 Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:34.730243 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'fb680b25-924b-466f-bdbf-296cb1945f93'} Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:34.731018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:34.732327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:34.733510 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Returning 404 to user: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:34.733510 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2b28b49f-bf9a-433e-bbf4-a040f939bf2e tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 404 len: 111 microversion: 2.1 time: 0.037063 Jun 21 16:04:34.733510 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 553/1088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:34 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:04:34.740841 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-429d3733-6852-4786-b0bd-41efb6a7294f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '.version_select at 0x7f73b5fe5670>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:34.766824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-429d3733-6852-4786-b0bd-41efb6a7294f tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072688377" status: 202 len: 0 microversion: 2.1 time: 0.030250 Jun 21 16:04:34.767377 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 536/1089] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jun 21 16:04:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072688377 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:04:37.978008 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:37.979250 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:37.989701 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:37.990353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:37.991465 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:37.992026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:38.009126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] HTTP exception thrown: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Request method failure captured: Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 HTTP/1.1 Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemEHj1PQfeyonPC5JhAMnvCJaBYPt7Bxh2KpgSGT-0GJo-Ki13Vu06q1KXcGThnz8KWiwakrA7uN6z2Bvbo08JEdQxNCvnUIpo7-zEwmTIhnhAjuYn1qgfVH6wDk_yWs3TZ4V1wkm_ndbz9GWwwIsXG9oc7TJObZ-EaDj9taalbNL0 Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:04:38.011024 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f35c94371b44c6936b1e713a398f1c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: fa5a48626c934dc2aa4f24002970b6d5 Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.013197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'fb680b25-924b-466f-bdbf-296cb1945f93'} Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:38.014380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.016200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.018394 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Returning 404 to user: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:38.018394 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f3b46991-94d4-4333-b5d5-2f727b858148 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 404 len: 111 microversion: 2.1 time: 0.044164 Jun 21 16:04:38.018833 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 554/1090] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:04:37 2022] DELETE /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:04:38.026376 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:38.028181 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: fb680b25-924b-466f-bdbf-296cb1945f93] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:38.031198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:38.038065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:38.038931 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:38.039962 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:38.040726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:38.057715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] HTTP exception thrown: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Request method failure captured: Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 HTTP/1.1 Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemEHj1PQfeyonPC5JhAMnvCJaBYPt7Bxh2KpgSGT-0GJo-Ki13Vu06q1KXcGThnz8KWiwakrA7uN6z2Bvbo08JEdQxNCvnUIpo7-zEwmTIhnhAjuYn1qgfVH6wDk_yWs3TZ4V1wkm_ndbz9GWwwIsXG9oc7TJObZ-EaDj9taalbNL0 Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:04:38.060567 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f35c94371b44c6936b1e713a398f1c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: fa5a48626c934dc2aa4f24002970b6d5 Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.062714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'fb680b25-924b-466f-bdbf-296cb1945f93'} Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:38.063696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. Jun 21 16:04:38.065397 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:38.068780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Returning 404 to user: Instance fb680b25-924b-466f-bdbf-296cb1945f93 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:38.068780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d7566923-a88a-422b-8df8-3b919c8d4337 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93" status: 404 len: 111 microversion: 2.1 time: 0.040101 Jun 21 16:04:38.068780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 537/1091] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:38 2022] GET /compute/v2.1/servers/fb680b25-924b-466f-bdbf-296cb1945f93 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 16:04:39.234575 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:39.236337 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:39.242897 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:39.253718 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:39.254624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:39.256239 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:39.257226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:39.284586 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] HTTP exception thrown: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Request method failure captured: Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 HTTP/1.1 Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemEHj1PQfeyonPC5JhAMnvCJaBYPt7Bxh2KpgSGT-0GJo-Ki13Vu06q1KXcGThnz8KWiwakrA7uN6z2Bvbo08JEdQxNCvnUIpo7-zEwmTIhnhAjuYn1qgfVH6wDk_yWs3TZ4V1wkm_ndbz9GWwwIsXG9oc7TJObZ-EaDj9taalbNL0 Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:04:39.287636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f35c94371b44c6936b1e713a398f1c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: fa5a48626c934dc2aa4f24002970b6d5 Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.290478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'c6f494bc-2b5c-48f9-9842-5982a0d81192'} Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:39.292068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.294567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.297817 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Returning 404 to user: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:39.297817 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0939e572-3a87-4785-83d3-1b0ef5057c56 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 404 len: 111 microversion: 2.1 time: 0.070671 Jun 21 16:04:39.305531 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 555/1092] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:04:39 2022] DELETE /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:04:39.310637 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:39.311245 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] [instance: c6f494bc-2b5c-48f9-9842-5982a0d81192] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:04:39.318101 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:39.318549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:39.319326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:04:39.319753 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:04:39.334912 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] HTTP exception thrown: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Request method failure captured: Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 HTTP/1.1 Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemEHj1PQfeyonPC5JhAMnvCJaBYPt7Bxh2KpgSGT-0GJo-Ki13Vu06q1KXcGThnz8KWiwakrA7uN6z2Bvbo08JEdQxNCvnUIpo7-zEwmTIhnhAjuYn1qgfVH6wDk_yWs3TZ4V1wkm_ndbz9GWwwIsXG9oc7TJObZ-EaDj9taalbNL0 Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:04:39.336493 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f35c94371b44c6936b1e713a398f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f35c94371b44c6936b1e713a398f1c", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 74f35c94371b44c6936b1e713a398f1c Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444011862 Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: fa5a48626c934dc2aa4f24002970b6d5 Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeTestJSON-444011862-project Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.338242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'c6f494bc-2b5c-48f9-9842-5982a0d81192'} Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:39.343846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. Jun 21 16:04:39.345499 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:39.346631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] Returning 404 to user: Instance c6f494bc-2b5c-48f9-9842-5982a0d81192 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:39.346631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d149d63a-ae1a-4c2c-9add-e8e0a233fb67 tempest-AttachVolumeTestJSON-444011862 tempest-AttachVolumeTestJSON-444011862-project] 10.222.0.52 "GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192" status: 404 len: 111 microversion: 2.1 time: 0.031311 Jun 21 16:04:39.346631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 538/1093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:04:39 2022] GET /compute/v2.1/servers/c6f494bc-2b5c-48f9-9842-5982a0d81192 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:04:44.658798 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-461f1371-3a33-4bff-8cfb-14c7af6e8d73 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Action: 'create', calling method: .version_select at 0x7f73b5fac1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1393613680", "metadata": {"Type": "work"}}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-461f1371-3a33-4bff-8cfb-14c7af6e8d73 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Request method failure captured: Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 122 Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisewcRF9iEyrMQFN6q0iVItIFk0RWoXiX807Ez0BxksFID0OPy0N8qoCxZveUtm9lunqrN0_gpETVjlBsKizn-st05v5baxYdNqq4qzGbPOk8GMB6zfza4Aq96Era6tX45PK3MFa_pkM-SfX0N34eE_VpsZj044z4zcCFLbnbixLobHw Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:04:44.678449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe6b9b8c5c0a4a2e92dbb57526264f88", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 01b720a07a5e44bdb7232ff9e5f9be49 Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1393613680", "metadata": {"Type": "work"}}} Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: Jun 21 16:04:44.680182 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1393613680', 'metadata': {'Type': 'work'}}}} Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise error Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:44.681148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 16:04:44.682591 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 16:04:44.683906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 16:04:44.683906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.683906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-461f1371-3a33-4bff-8cfb-14c7af6e8d73 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:44.683906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-461f1371-3a33-4bff-8cfb-14c7af6e8d73 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145703 Jun 21 16:04:44.683906 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 556/1094] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jun 21 16:04:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:04:44.691056 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e09dd84e-2744-471b-be53-b7af390487e4 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Action: 'create', calling method: .version_select at 0x7f73b5ec44c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1969466463", "metadata": {"Type": "work"}}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e09dd84e-2744-471b-be53-b7af390487e4 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Request method failure captured: Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 120 Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisewcRF9iEyrMQFN6q0iVItIFk0RWoXiX807Ez0BxksFID0OPy0N8qoCxZveUtm9lunqrN0_gpETVjlBsKizn-st05v5baxYdNqq4qzGbPOk8GMB6zfza4Aq96Era6tX45PK3MFa_pkM-SfX0N34eE_VpsZj044z4zcCFLbnbixLobHw Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:04:44.694310 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe6b9b8c5c0a4a2e92dbb57526264f88", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 01b720a07a5e44bdb7232ff9e5f9be49 Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1969466463", "metadata": {"Type": "work"}}} Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: Jun 21 16:04:44.695846 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1969466463', 'metadata': {'Type': 'work'}}}} Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise error Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi '0' Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:44.696711 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 16:04:44.697998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 16:04:44.699153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 16:04:44.699153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.699153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e09dd84e-2744-471b-be53-b7af390487e4 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:44.699153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e09dd84e-2744-471b-be53-b7af390487e4 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009116 Jun 21 16:04:44.699153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 539/1095] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jun 21 16:04:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 16:04:44.706217 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c8e16453-4fdc-4d03-8c17-10e62a5fd177 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Action: 'create', calling method: .version_select at 0x7f73b5feb940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-961050181", "metadata": {"Type": "work"}}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c8e16453-4fdc-4d03-8c17-10e62a5fd177 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Request method failure captured: Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 118 Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisewcRF9iEyrMQFN6q0iVItIFk0RWoXiX807Ez0BxksFID0OPy0N8qoCxZveUtm9lunqrN0_gpETVjlBsKizn-st05v5baxYdNqq4qzGbPOk8GMB6zfza4Aq96Era6tX45PK3MFa_pkM-SfX0N34eE_VpsZj044z4zcCFLbnbixLobHw Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:04:44.709590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe6b9b8c5c0a4a2e92dbb57526264f88", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 01b720a07a5e44bdb7232ff9e5f9be49 Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-961050181", "metadata": {"Type": "work"}}} Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: Jun 21 16:04:44.711278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-961050181', 'metadata': {'Type': 'work'}}}} Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise error Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi '' Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:44.712226 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 16:04:44.714175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 16:04:44.715422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 16:04:44.715422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.715422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c8e16453-4fdc-4d03-8c17-10e62a5fd177 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:44.715422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c8e16453-4fdc-4d03-8c17-10e62a5fd177 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008975 Jun 21 16:04:44.715422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 557/1096] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jun 21 16:04:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:04:44.721387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0946eb86-b335-43ec-93a6-6354bf8f0063 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Calling method '.version_select at 0x7f73b5e25430>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:44.750834 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-0946eb86-b335-43ec-93a6-6354bf8f0063 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] HTTP exception thrown: Volume tempest-invalid-386896732 could not be found. Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0946eb86-b335-43ec-93a6-6354bf8f0063 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Request method failure captured: Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-386896732 HTTP/1.1 Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisewcRF9iEyrMQFN6q0iVItIFk0RWoXiX807Ez0BxksFID0OPy0N8qoCxZveUtm9lunqrN0_gpETVjlBsKizn-st05v5baxYdNqq4qzGbPOk8GMB6zfza4Aq96Era6tX45PK3MFa_pkM-SfX0N34eE_VpsZj044z4zcCFLbnbixLobHw Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:04:44.752818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe6b9b8c5c0a4a2e92dbb57526264f88", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 01b720a07a5e44bdb7232ff9e5f9be49 Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Volume tempest-invalid-386896732 could not be found. Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'tempest-invalid-386896732'} Jun 21 16:04:44.754211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-386896732 could not be found. (HTTP 404) (Request-ID: req-581ba83a-44fe-4a35-9595-e6ea277a2c81) Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.755073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:04:44.756257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-386896732 could not be found. Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:44.757704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-386896732 could not be found. Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-386896732 could not be found. Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0946eb86-b335-43ec-93a6-6354bf8f0063 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Returning 404 to user: Volume tempest-invalid-386896732 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0946eb86-b335-43ec-93a6-6354bf8f0063 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-386896732" status: 404 len: 98 microversion: 2.1 time: 0.036931 Jun 21 16:04:44.759272 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 540/1097] 10.222.0.52 () {58 vars in 1214 bytes} [Tue Jun 21 16:04:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-386896732 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 21 16:04:44.764523 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-278fc73a-6a02-4709-9564-9c8f5e651867 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003966 Jun 21 16:04:44.765027 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 558/1098] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Jun 21 16:04:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 21 16:04:44.773575 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b4bb9900-2def-49c6-a3a9-d0dc3c5f75a9 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003713 Jun 21 16:04:44.774097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 541/1099] 10.222.0.52 () {58 vars in 1136 bytes} [Tue Jun 21 16:04:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 21 16:04:44.782676 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9a99324a-8c5b-48b4-ad1b-8508645d8667 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Calling method '.version_select at 0x7f73b7c0d1f0>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:44.811461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-9a99324a-8c5b-48b4-ad1b-8508645d8667 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] HTTP exception thrown: Volume d0ea1207-b948-4101-ad07-f12f3cd66873 could not be found. Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9a99324a-8c5b-48b4-ad1b-8508645d8667 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Request method failure captured: Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/os-volumes/d0ea1207-b948-4101-ad07-f12f3cd66873 HTTP/1.1 Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisewcRF9iEyrMQFN6q0iVItIFk0RWoXiX807Ez0BxksFID0OPy0N8qoCxZveUtm9lunqrN0_gpETVjlBsKizn-st05v5baxYdNqq4qzGbPOk8GMB6zfza4Aq96Era6tX45PK3MFa_pkM-SfX0N34eE_VpsZj044z4zcCFLbnbixLobHw Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:04:44.814776 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe6b9b8c5c0a4a2e92dbb57526264f88", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 01b720a07a5e44bdb7232ff9e5f9be49 Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Volume d0ea1207-b948-4101-ad07-f12f3cd66873 could not be found. Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'd0ea1207-b948-4101-ad07-f12f3cd66873'} Jun 21 16:04:44.816389 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0ea1207-b948-4101-ad07-f12f3cd66873 could not be found. (HTTP 404) (Request-ID: req-d284aa49-ea74-47f0-8617-064079755d41) Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.817322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:04:44.818595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0ea1207-b948-4101-ad07-f12f3cd66873 could not be found. Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 16:04:44.819698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0ea1207-b948-4101-ad07-f12f3cd66873 could not be found. Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0ea1207-b948-4101-ad07-f12f3cd66873 could not be found. Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9a99324a-8c5b-48b4-ad1b-8508645d8667 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Returning 404 to user: Volume d0ea1207-b948-4101-ad07-f12f3cd66873 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9a99324a-8c5b-48b4-ad1b-8508645d8667 tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/d0ea1207-b948-4101-ad07-f12f3cd66873" status: 404 len: 109 microversion: 2.1 time: 0.037352 Jun 21 16:04:44.820848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 559/1100] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 16:04:44 2022] DELETE /compute/v2.1/os-volumes/d0ea1207-b948-4101-ad07-f12f3cd66873 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:04:44.826252 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-791aec8c-5c09-443e-8232-720c2707fd2e tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Calling method '.version_select at 0x7f73b7c1e4c0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:04:44.856144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-791aec8c-5c09-443e-8232-720c2707fd2e tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] HTTP exception thrown: Volume 4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 could not be found. Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-791aec8c-5c09-443e-8232-720c2707fd2e tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Request method failure captured: Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/os-volumes/4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 HTTP/1.1 Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisewcRF9iEyrMQFN6q0iVItIFk0RWoXiX807Ez0BxksFID0OPy0N8qoCxZveUtm9lunqrN0_gpETVjlBsKizn-st05v5baxYdNqq4qzGbPOk8GMB6zfza4Aq96Era6tX45PK3MFa_pkM-SfX0N34eE_VpsZj044z4zcCFLbnbixLobHw Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:04:44.858496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe6b9b8c5c0a4a2e92dbb57526264f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe6b9b8c5c0a4a2e92dbb57526264f88", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: fe6b9b8c5c0a4a2e92dbb57526264f88 Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-VolumesNegativeTest-417952100 Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 01b720a07a5e44bdb7232ff9e5f9be49 Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-VolumesNegativeTest-417952100-project Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Volume 4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 could not be found. Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '4a2aa115-3729-4f9b-9c7b-f42702b9b6d4'} Jun 21 16:04:44.859825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 could not be found. (HTTP 404) (Request-ID: req-93da875b-56ac-4279-989b-79f1efd1c679) Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.860716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:04:44.862142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 could not be found. Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 16:04:44.863824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 could not be found. Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 could not be found. Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-791aec8c-5c09-443e-8232-720c2707fd2e tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] Returning 404 to user: Volume 4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-791aec8c-5c09-443e-8232-720c2707fd2e tempest-VolumesNegativeTest-417952100 tempest-VolumesNegativeTest-417952100-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/4a2aa115-3729-4f9b-9c7b-f42702b9b6d4" status: 404 len: 109 microversion: 2.1 time: 0.037641 Jun 21 16:04:44.865367 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 542/1101] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jun 21 16:04:44 2022] GET /compute/v2.1/os-volumes/4a2aa115-3729-4f9b-9c7b-f42702b9b6d4 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:13.279927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:13.280674 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:13.286110 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fc27df15-84ae-4a16-8af2-c5357f4b2bc9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:13.287089 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fc27df15-84ae-4a16-8af2-c5357f4b2bc9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:13.294299 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fc27df15-84ae-4a16-8af2-c5357f4b2bc9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:13.294813 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fc27df15-84ae-4a16-8af2-c5357f4b2bc9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:13.295573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fc27df15-84ae-4a16-8af2-c5357f4b2bc9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:13.295990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fc27df15-84ae-4a16-8af2-c5357f4b2bc9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:13.327072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fc27df15-84ae-4a16-8af2-c5357f4b2bc9 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048572 Jun 21 16:05:13.327629 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 560/1102] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jun 21 16:05:13 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:13.394473 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:13.395444 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:13.402695 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-34c8e9e4-14b3-4ba0-8469-c306e2ecce99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:13.403627 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-34c8e9e4-14b3-4ba0-8469-c306e2ecce99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:13.413042 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-34c8e9e4-14b3-4ba0-8469-c306e2ecce99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:13.413478 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-34c8e9e4-14b3-4ba0-8469-c306e2ecce99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:13.414256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-34c8e9e4-14b3-4ba0-8469-c306e2ecce99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:13.414678 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-34c8e9e4-14b3-4ba0-8469-c306e2ecce99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:13.441286 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-34c8e9e4-14b3-4ba0-8469-c306e2ecce99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Going to try to terminate instance {{(pid=123939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:05:13.521743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-34c8e9e4-14b3-4ba0-8469-c306e2ecce99 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 204 len: 0 microversion: 2.20 time: 0.128860 Jun 21 16:05:13.522375 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 543/1103] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jun 21 16:05:13 2022] DELETE /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 16:05:13.530876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:13.531477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:13.543388 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:13.543873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:13.544677 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:13.545104 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:13.687695 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:13.696452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:13.698021 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:13.699191 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-66192922-6c66-4267-ac3a-2078251b3457 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.172356 Jun 21 16:05:13.699735 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 561/1104] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:05:13 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:05:14.728481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:14.729642 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:14.738667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:14.739110 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:14.739871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:14.740295 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:14.886605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:14.895370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:14.896842 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:14.898229 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-57bd953e-cd95-4586-82c7-60f7e5aec89d tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1722 microversion: 2.20 time: 0.177140 Jun 21 16:05:14.898766 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 544/1105] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:05:14 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:05:15.874593 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cfd72145-5247-43d8-9792-4f2f037ce117 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:15.875136 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cfd72145-5247-43d8-9792-4f2f037ce117 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:15.882767 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cfd72145-5247-43d8-9792-4f2f037ce117 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:15.883218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cfd72145-5247-43d8-9792-4f2f037ce117 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:15.883994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cfd72145-5247-43d8-9792-4f2f037ce117 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:15.884462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cfd72145-5247-43d8-9792-4f2f037ce117 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:15.911811 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cfd72145-5247-43d8-9792-4f2f037ce117 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:05:15.916461 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:15.917606 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:15.925516 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:15.926214 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:15.927166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:15.927789 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:16.022519 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:16.034032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:16.036682 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:16.038968 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-565c0b76-4e98-47b8-95d9-707d45d1c76a tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1655 microversion: 2.20 time: 0.126422 Jun 21 16:05:16.040132 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 545/1106] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:05:15 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1655 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:05:16.057413 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cfd72145-5247-43d8-9792-4f2f037ce117 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 204 len: 0 microversion: 2.1 time: 0.186306 Jun 21 16:05:16.058565 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 562/1107] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:05:15 2022] DELETE /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:05:16.067144 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-53bdb153-2473-43a9-8c6f-8bf023a63f33 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:16.067786 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-53bdb153-2473-43a9-8c6f-8bf023a63f33 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:16.073900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-53bdb153-2473-43a9-8c6f-8bf023a63f33 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:16.074347 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-53bdb153-2473-43a9-8c6f-8bf023a63f33 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:16.075109 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-53bdb153-2473-43a9-8c6f-8bf023a63f33 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:16.075570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-53bdb153-2473-43a9-8c6f-8bf023a63f33 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:16.373390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-53bdb153-2473-43a9-8c6f-8bf023a63f33 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:16.385373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-53bdb153-2473-43a9-8c6f-8bf023a63f33 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1576 microversion: 2.1 time: 0.322335 Jun 21 16:05:16.397094 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 546/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:16 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1576 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:05:16.495173 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-8f08d376-e057-4cab-9b26-9ba7fde8bc2c req-d626c698-2cdf-46bb-9cab-6386ef3f841a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cea78e9-1d9b-4b08-bbe5-93fadd09e685", "name": "network-vif-deleted", "tag": "b76d21d6-4f2c-4f99-a9ef-d06b45b48736"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:16.503443 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-8f08d376-e057-4cab-9b26-9ba7fde8bc2c req-d626c698-2cdf-46bb-9cab-6386ef3f841a service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:16.503882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-8f08d376-e057-4cab-9b26-9ba7fde8bc2c req-d626c698-2cdf-46bb-9cab-6386ef3f841a service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:16.516503 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-8f08d376-e057-4cab-9b26-9ba7fde8bc2c req-d626c698-2cdf-46bb-9cab-6386ef3f841a service nova] Creating event network-vif-deleted:b76d21d6-4f2c-4f99-a9ef-d06b45b48736 for instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 on hv-cinder-84067 Jun 21 16:05:16.521706 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-8f08d376-e057-4cab-9b26-9ba7fde8bc2c req-d626c698-2cdf-46bb-9cab-6386ef3f841a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030976 Jun 21 16:05:16.522656 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 563/1109] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:17.059552 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:17.060965 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:17.067429 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:17.067897 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:17.068617 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:17.069251 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:17.186745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:17.202384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:17.204377 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75407a21b1fd46e8ba10540fc5a4c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f5c4b63c45d691e2b66883eda54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:17.206096 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2062e2e0-4380-4080-aeed-0e599cf32c60 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 200 len: 1655 microversion: 2.20 time: 0.151033 Jun 21 16:05:17.206808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 547/1110] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:05:17 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:05:17.405745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-13dd0f8b-4564-4a3c-bf47-37da21b24085 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:17.406473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-13dd0f8b-4564-4a3c-bf47-37da21b24085 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:17.414212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-13dd0f8b-4564-4a3c-bf47-37da21b24085 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:17.414654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-13dd0f8b-4564-4a3c-bf47-37da21b24085 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:17.415397 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-13dd0f8b-4564-4a3c-bf47-37da21b24085 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:17.415984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-13dd0f8b-4564-4a3c-bf47-37da21b24085 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:17.564464 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-13dd0f8b-4564-4a3c-bf47-37da21b24085 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:17.573193 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-13dd0f8b-4564-4a3c-bf47-37da21b24085 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1576 microversion: 2.1 time: 0.173364 Jun 21 16:05:17.574110 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 564/1111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:17 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:17.958369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-19188b41-4701-4008-8b10-2d743e89139e req-d0e05edf-78ea-443a-bc24-25920c0d7f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb343e0-4cd2-4d5e-96e7-3118e40b27d9", "name": "network-vif-unplugged", "status": "completed", "tag": "9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:17.972966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-19188b41-4701-4008-8b10-2d743e89139e req-d0e05edf-78ea-443a-bc24-25920c0d7f98 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:17.973520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-19188b41-4701-4008-8b10-2d743e89139e req-d0e05edf-78ea-443a-bc24-25920c0d7f98 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:17.989165 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-19188b41-4701-4008-8b10-2d743e89139e req-d0e05edf-78ea-443a-bc24-25920c0d7f98 service nova] Creating event network-vif-unplugged:9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe for instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 on hv-cinder-84067 Jun 21 16:05:18.005028 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-19188b41-4701-4008-8b10-2d743e89139e req-d0e05edf-78ea-443a-bc24-25920c0d7f98 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051203 Jun 21 16:05:18.014032 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 548/1112] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:18.224686 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:18.225458 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:18.232647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:18.233077 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:18.233972 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:18.234454 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:18.251636 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] HTTP exception thrown: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Request method failure captured: Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 HTTP/1.1 Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemOBnizETzZO5s2RmHKmbdXQpcyAhNyvmOWYGE4F95pvQplUfOu-0Wqlc-mPqPNtY9VaHHU0VnqJ_0aB7G5aZkoIhJ4Nlt9vm52QcaDtj1Ipk5T65T4L6N950xXzSsOfD6BwAQUa6hHLvlE0IA0EvLxFgMSYFN2TxCofd_uslOEMcE Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:05:18.253334 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f3f5c4b63c45d691e2b66883eda54a", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 75407a21b1fd46e8ba10540fc5a4c30a Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:18.254828 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '5cea78e9-1d9b-4b08-bbe5-93fadd09e685'} Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:18.255704 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:18.257007 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:18.258203 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Returning 404 to user: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:18.258203 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7c438bab-044e-4c38-bf6e-92ba064329f6 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 404 len: 111 microversion: 2.20 time: 0.034113 Jun 21 16:05:18.258203 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 565/1113] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:05:18 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:05:18.266311 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-838648c5-eb20-4d8e-9303-c0bca264b5f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '.version_select at 0x7f73b5f22ca0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:18.292326 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-838648c5-eb20-4d8e-9303-c0bca264b5f1 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328571372" status: 204 len: 0 microversion: 2.20 time: 0.030650 Jun 21 16:05:18.292986 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 549/1114] 10.222.0.52 () {60 vars in 1261 bytes} [Tue Jun 21 16:05:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328571372 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 16:05:18.593420 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c03663c6-95bc-4e22-8633-c4593801c8e3 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:18.594161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c03663c6-95bc-4e22-8633-c4593801c8e3 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:18.601951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c03663c6-95bc-4e22-8633-c4593801c8e3 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:18.603041 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c03663c6-95bc-4e22-8633-c4593801c8e3 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:18.604138 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c03663c6-95bc-4e22-8633-c4593801c8e3 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:18.604918 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c03663c6-95bc-4e22-8633-c4593801c8e3 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:18.965980 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c03663c6-95bc-4e22-8633-c4593801c8e3 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:18.974715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c03663c6-95bc-4e22-8633-c4593801c8e3 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1576 microversion: 2.1 time: 0.388271 Jun 21 16:05:18.975339 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 566/1115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:18 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1576 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:19.647035 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-46f9a4b4-1bf4-402b-b053-91b1072ba2ca req-ddaf36da-c6aa-4445-9511-bc84ea80534b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb343e0-4cd2-4d5e-96e7-3118e40b27d9", "name": "network-vif-deleted", "tag": "9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:19.661595 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-46f9a4b4-1bf4-402b-b053-91b1072ba2ca req-ddaf36da-c6aa-4445-9511-bc84ea80534b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:19.662025 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-46f9a4b4-1bf4-402b-b053-91b1072ba2ca req-ddaf36da-c6aa-4445-9511-bc84ea80534b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:19.675728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-46f9a4b4-1bf4-402b-b053-91b1072ba2ca req-ddaf36da-c6aa-4445-9511-bc84ea80534b service nova] Creating event network-vif-deleted:9010cbd2-bb0a-4f15-a96e-dc982ad8dcfe for instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 on hv-cinder-84067 Jun 21 16:05:19.681056 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-46f9a4b4-1bf4-402b-b053-91b1072ba2ca req-ddaf36da-c6aa-4445-9511-bc84ea80534b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040866 Jun 21 16:05:19.682291 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 550/1116] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:19.992504 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:19.993710 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:20.000120 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:20.000662 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:20.001618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:20.002096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:20.035931 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:20.036409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:20.036848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lazy-loading 'fault' on Instance uuid bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:05:20.079185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:20.087610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-458128d1-ea43-421f-abb8-36fd3d27e3f2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 200 len: 1230 microversion: 2.1 time: 0.099590 Jun 21 16:05:20.088224 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 567/1117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:19 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:05:20.572159 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:20.573450 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:20.581646 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:20.581896 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:20.582933 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:20.583307 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:20.601986 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] HTTP exception thrown: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Request method failure captured: Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: DELETE /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 HTTP/1.1 Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemOBnizETzZO5s2RmHKmbdXQpcyAhNyvmOWYGE4F95pvQplUfOu-0Wqlc-mPqPNtY9VaHHU0VnqJ_0aB7G5aZkoIhJ4Nlt9vm52QcaDtj1Ipk5T65T4L6N950xXzSsOfD6BwAQUa6hHLvlE0IA0EvLxFgMSYFN2TxCofd_uslOEMcE Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:20.603843 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f3f5c4b63c45d691e2b66883eda54a", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 75407a21b1fd46e8ba10540fc5a4c30a Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.605570 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '5cea78e9-1d9b-4b08-bbe5-93fadd09e685'} Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:20.606370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.607619 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.608853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Returning 404 to user: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:20.608853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-26617a4c-8d64-4352-bbe8-0b01fba2b968 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 404 len: 111 microversion: 2.20 time: 0.037403 Jun 21 16:05:20.608853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 551/1118] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jun 21 16:05:20 2022] DELETE /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:05:20.614450 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:20.615058 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 5cea78e9-1d9b-4b08-bbe5-93fadd09e685] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:20.621510 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:20.622094 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:20.622864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:20.623379 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:20.637643 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] HTTP exception thrown: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Request method failure captured: Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 HTTP/1.1 Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemOBnizETzZO5s2RmHKmbdXQpcyAhNyvmOWYGE4F95pvQplUfOu-0Wqlc-mPqPNtY9VaHHU0VnqJ_0aB7G5aZkoIhJ4Nlt9vm52QcaDtj1Ipk5T65T4L6N950xXzSsOfD6BwAQUa6hHLvlE0IA0EvLxFgMSYFN2TxCofd_uslOEMcE Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:05:20.639505 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f3f5c4b63c45d691e2b66883eda54a", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 75407a21b1fd46e8ba10540fc5a4c30a Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.641032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '5cea78e9-1d9b-4b08-bbe5-93fadd09e685'} Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:20.641764 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. Jun 21 16:05:20.643653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:20.645282 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Returning 404 to user: Instance 5cea78e9-1d9b-4b08-bbe5-93fadd09e685 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:20.645282 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5e146415-0cad-4fbd-89eb-44de21caf24e tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685" status: 404 len: 111 microversion: 2.20 time: 0.030771 Jun 21 16:05:20.645282 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 568/1119] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:05:20 2022] GET /compute/v2.1/servers/5cea78e9-1d9b-4b08-bbe5-93fadd09e685 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:05:20.705992 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:05:20.706254 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Tue Jun 21 16:05:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:05:21.105404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:21.106017 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:21.113351 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:21.114013 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:21.114829 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:21.115263 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:21.130343 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] HTTP exception thrown: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Request method failure captured: Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 HTTP/1.1 Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiset4_DRo-EnBREsEgYE8p7XIxPivHtsYt6-qrNIgBQYDLa1OULRsRs-HzALAAP9S16pvmPoM1lIg8rWqv737DRUv5vW42P1cRFGcxMxBOy3fGpVOgaYezstCqwNsAvDtDGtc66s8P4zgIx7PNKqFEDI8pKN8OS5j9Q52tJrhTAWoY3U Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:21.132058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/658a35680c70498db2bccc1085c22b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_658a35680c70498db2bccc1085c22b21", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-TestVolumeBootPattern-263623053 Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 0943474b3d4d49d7973619388dab2be1 Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:05:21.133413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'bdb343e0-4cd2-4d5e-96e7-3118e40b27d9'} Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:21.134209 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:05:21.135636 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.136900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Returning 404 to user: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:21.136900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e5ab98ef-38b9-4e3a-b32b-3b993a2a1310 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 404 len: 111 microversion: 2.1 time: 0.032041 Jun 21 16:05:21.136900 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 552/1120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:21 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:21.238872 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-532806714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-877953109", "security_groups": [{"name": "tempest-secgroup-smoke-930699362"}], "block_device_mapping_v2": [{"uuid": "f20bb2cc-6f67-4c6b-b5fc-739f80ed0beb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "394d887b-9dbe-47a5-a600-3a263ed9e0b8"}]}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:21.361947 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.network.neutron [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] validate_networks() for [('394d887b-9dbe-47a5-a600-3a263ed9e0b8', None, None, None, None, None)] {{(pid=123938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:05:21.768986 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Flavor limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:05:21.769584 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Image limits 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:05:21.770087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Flavor pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:05:21.770548 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Image pref 0:0:0 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:05:21.770924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.virt.hardware [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:05:21.785705 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:21.786196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:21.786994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:21.789137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:21.792177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:21.792658 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:21.799966 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:21.800750 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:21.801758 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:21.802315 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:21.808736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Getting quotas for project 658a35680c70498db2bccc1085c22b21. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:05:21.813344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Getting quotas for user 0943474b3d4d49d7973619388dab2be1 and project 658a35680c70498db2bccc1085c22b21. Resources: {'cores', 'instances', 'ram'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:05:21.817622 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] HTTP exception thrown: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Request method failure captured: Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: DELETE /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae HTTP/1.1 Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemOBnizETzZO5s2RmHKmbdXQpcyAhNyvmOWYGE4F95pvQplUfOu-0Wqlc-mPqPNtY9VaHHU0VnqJ_0aB7G5aZkoIhJ4Nlt9vm52QcaDtj1Ipk5T65T4L6N950xXzSsOfD6BwAQUa6hHLvlE0IA0EvLxFgMSYFN2TxCofd_uslOEMcE Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:21.819232 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f3f5c4b63c45d691e2b66883eda54a", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 75407a21b1fd46e8ba10540fc5a4c30a Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.820964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '899aef0a-2cf7-47b2-9b08-0068bde58dae'} Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:21.821864 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.823389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.825540 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Returning 404 to user: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:21.826407 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e7b4bdb1-946c-4550-8984-484fb1d93a77 tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 404 len: 111 microversion: 2.20 time: 0.038132 Jun 21 16:05:21.826961 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 553/1121] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jun 21 16:05:21 2022] DELETE /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:05:21.836116 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:21.836799 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] [instance: 899aef0a-2cf7-47b2-9b08-0068bde58dae] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:21.843685 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:21.844127 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:21.844889 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:21.845350 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:21.867211 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] HTTP exception thrown: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Request method failure captured: Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae HTTP/1.1 Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemOBnizETzZO5s2RmHKmbdXQpcyAhNyvmOWYGE4F95pvQplUfOu-0Wqlc-mPqPNtY9VaHHU0VnqJ_0aB7G5aZkoIhJ4Nlt9vm52QcaDtj1Ipk5T65T4L6N950xXzSsOfD6BwAQUa6hHLvlE0IA0EvLxFgMSYFN2TxCofd_uslOEMcE Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:21.868755 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74f3f5c4b63c45d691e2b66883eda54a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74f3f5c4b63c45d691e2b66883eda54a", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 74f3f5c4b63c45d691e2b66883eda54a Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611863489 Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 75407a21b1fd46e8ba10540fc5a4c30a Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611863489-project Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.870428 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '899aef0a-2cf7-47b2-9b08-0068bde58dae'} Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:21.871293 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. Jun 21 16:05:21.872558 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:21.873768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] Returning 404 to user: Instance 899aef0a-2cf7-47b2-9b08-0068bde58dae could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:21.873768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b72e8ed8-8ad0-4459-8b5a-0dd588d9b0bd tempest-AttachVolumeShelveTestJSON-1611863489 tempest-AttachVolumeShelveTestJSON-1611863489-project] 10.222.0.52 "GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae" status: 404 len: 111 microversion: 2.20 time: 0.038024 Jun 21 16:05:21.873768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 554/1122] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jun 21 16:05:21 2022] GET /compute/v2.1/servers/899aef0a-2cf7-47b2-9b08-0068bde58dae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 21 16:05:21.885899 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Going to run 1 instances... {{(pid=123938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:05:21.888230 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f20bb2cc-6f67-4c6b-b5fc-739f80ed0beb',volume_size=None,volume_type=None)] {{(pid=123938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:05:22.036100 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-34121b61-b716-4f3a-b244-b8ede3ecb37d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.801370 Jun 21 16:05:22.041998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 569/1123] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:05:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:05:22.047253 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8aa2676f-bd17-420d-8861-3211d4545c12 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:22.047949 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8aa2676f-bd17-420d-8861-3211d4545c12 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:22.138070 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8aa2676f-bd17-420d-8861-3211d4545c12 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:22.150168 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8aa2676f-bd17-420d-8861-3211d4545c12 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1093 microversion: 2.1 time: 0.106442 Jun 21 16:05:22.151036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 555/1124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:22 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1093 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:23.167987 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-06bdadf0-d813-4e70-9c5a-5b37030d15f4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:23.168775 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-06bdadf0-d813-4e70-9c5a-5b37030d15f4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:23.177410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06bdadf0-d813-4e70-9c5a-5b37030d15f4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:23.179275 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06bdadf0-d813-4e70-9c5a-5b37030d15f4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:23.181442 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06bdadf0-d813-4e70-9c5a-5b37030d15f4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:23.183092 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-06bdadf0-d813-4e70-9c5a-5b37030d15f4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:23.245346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fee6f671-6fcc-4f68-a563-8895f78ca99e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:23.246681 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fee6f671-6fcc-4f68-a563-8895f78ca99e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:23.256897 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fee6f671-6fcc-4f68-a563-8895f78ca99e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:23.257502 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fee6f671-6fcc-4f68-a563-8895f78ca99e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:23.258560 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fee6f671-6fcc-4f68-a563-8895f78ca99e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:23.259100 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fee6f671-6fcc-4f68-a563-8895f78ca99e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:23.285735 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fee6f671-6fcc-4f68-a563-8895f78ca99e tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/ips" status: 200 len: 150 microversion: 2.1 time: 0.047829 Jun 21 16:05:23.286487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 556/1125] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jun 21 16:05:23 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:23.317761 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-06bdadf0-d813-4e70-9c5a-5b37030d15f4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:23.325461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-06bdadf0-d813-4e70-9c5a-5b37030d15f4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1209 microversion: 2.1 time: 0.161761 Jun 21 16:05:23.340285 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 570/1126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:23 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1209 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:24.348997 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-77ea071c-45ab-49be-99a2-acd802b53cde tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:24.349603 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-77ea071c-45ab-49be-99a2-acd802b53cde tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:24.356688 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-77ea071c-45ab-49be-99a2-acd802b53cde tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:24.357359 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-77ea071c-45ab-49be-99a2-acd802b53cde tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:24.358156 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-77ea071c-45ab-49be-99a2-acd802b53cde tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:24.358572 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-77ea071c-45ab-49be-99a2-acd802b53cde tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:24.447319 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-77ea071c-45ab-49be-99a2-acd802b53cde tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:24.455447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-77ea071c-45ab-49be-99a2-acd802b53cde tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1197 microversion: 2.1 time: 0.115276 Jun 21 16:05:24.456754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 557/1127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:24 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:24.685263 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d3314a83-ae73-4f7c-bd80-3da2a18b638d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34a28d4c-e1b7-471c-bd88-13a6784b6313"}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:24.686937 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d3314a83-ae73-4f7c-bd80-3da2a18b638d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:24.695055 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3314a83-ae73-4f7c-bd80-3da2a18b638d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:24.695515 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3314a83-ae73-4f7c-bd80-3da2a18b638d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:24.696476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3314a83-ae73-4f7c-bd80-3da2a18b638d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:24.697106 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d3314a83-ae73-4f7c-bd80-3da2a18b638d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:25.103105 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d3314a83-ae73-4f7c-bd80-3da2a18b638d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "POST /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421757 Jun 21 16:05:25.105809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 571/1128] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jun 21 16:05:24 2022] POST /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:25.475716 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-19a226fd-1673-453f-93f6-53b7d491bfa8 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:25.476831 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-19a226fd-1673-453f-93f6-53b7d491bfa8 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:25.485840 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19a226fd-1673-453f-93f6-53b7d491bfa8 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:25.486918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19a226fd-1673-453f-93f6-53b7d491bfa8 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:25.487763 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19a226fd-1673-453f-93f6-53b7d491bfa8 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:25.488222 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-19a226fd-1673-453f-93f6-53b7d491bfa8 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:25.866992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-19a226fd-1673-453f-93f6-53b7d491bfa8 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:25.879401 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-19a226fd-1673-453f-93f6-53b7d491bfa8 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.408985 Jun 21 16:05:25.880018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 558/1129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:25 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:26.171072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-5c6c704d-c6a7-4bc6-8e10-11b9ffff2506 req-f0f5fb6b-4802-44cb-8f50-c8b07b497add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f8c983-c477-4e4e-9849-b32ce457ae59", "tag": "0713c871-4f3f-44fa-9891-a72dde86a445"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:26.203325 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-5c6c704d-c6a7-4bc6-8e10-11b9ffff2506 req-f0f5fb6b-4802-44cb-8f50-c8b07b497add service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:26.204608 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-5c6c704d-c6a7-4bc6-8e10-11b9ffff2506 req-f0f5fb6b-4802-44cb-8f50-c8b07b497add service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:26.226571 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-5c6c704d-c6a7-4bc6-8e10-11b9ffff2506 req-f0f5fb6b-4802-44cb-8f50-c8b07b497add service nova] Creating event network-changed:0713c871-4f3f-44fa-9891-a72dde86a445 for instance 85f8c983-c477-4e4e-9849-b32ce457ae59 on hv-cinder-84067 Jun 21 16:05:26.242396 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-5c6c704d-c6a7-4bc6-8e10-11b9ffff2506 req-f0f5fb6b-4802-44cb-8f50-c8b07b497add service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084376 Jun 21 16:05:26.243682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 572/1130] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:26.897859 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1a8ad4cd-3db5-4095-b3fe-3c89efa1ef3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:26.898440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1a8ad4cd-3db5-4095-b3fe-3c89efa1ef3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:26.905725 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a8ad4cd-3db5-4095-b3fe-3c89efa1ef3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:26.906498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a8ad4cd-3db5-4095-b3fe-3c89efa1ef3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:26.907253 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a8ad4cd-3db5-4095-b3fe-3c89efa1ef3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:26.907667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1a8ad4cd-3db5-4095-b3fe-3c89efa1ef3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:27.153464 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1a8ad4cd-3db5-4095-b3fe-3c89efa1ef3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:27.162218 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1a8ad4cd-3db5-4095-b3fe-3c89efa1ef3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.269030 Jun 21 16:05:27.163019 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 559/1131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:26 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:28.181245 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e62b7372-c727-4be4-9adf-c377ec439747 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:28.182053 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e62b7372-c727-4be4-9adf-c377ec439747 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:28.191127 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e62b7372-c727-4be4-9adf-c377ec439747 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:28.191690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e62b7372-c727-4be4-9adf-c377ec439747 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:28.192744 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e62b7372-c727-4be4-9adf-c377ec439747 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:28.194012 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e62b7372-c727-4be4-9adf-c377ec439747 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:28.448438 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e62b7372-c727-4be4-9adf-c377ec439747 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:28.460154 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e62b7372-c727-4be4-9adf-c377ec439747 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.284239 Jun 21 16:05:28.460741 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 573/1132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:28 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:29.480764 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8a167f73-857f-4ba7-868b-427020c10696 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:29.481289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8a167f73-857f-4ba7-868b-427020c10696 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:29.491055 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8a167f73-857f-4ba7-868b-427020c10696 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:29.491496 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8a167f73-857f-4ba7-868b-427020c10696 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:29.492275 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8a167f73-857f-4ba7-868b-427020c10696 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:29.492701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8a167f73-857f-4ba7-868b-427020c10696 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:29.631447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8a167f73-857f-4ba7-868b-427020c10696 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:29.642955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8a167f73-857f-4ba7-868b-427020c10696 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.168220 Jun 21 16:05:29.643949 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 560/1133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:29 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:30.662356 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-48323054-ced9-46cf-b286-bd0b07769087 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:30.663057 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-48323054-ced9-46cf-b286-bd0b07769087 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:30.670375 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-48323054-ced9-46cf-b286-bd0b07769087 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:30.671231 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-48323054-ced9-46cf-b286-bd0b07769087 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:30.672155 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-48323054-ced9-46cf-b286-bd0b07769087 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:30.672597 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-48323054-ced9-46cf-b286-bd0b07769087 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:30.825843 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-48323054-ced9-46cf-b286-bd0b07769087 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:30.838459 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-48323054-ced9-46cf-b286-bd0b07769087 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.181387 Jun 21 16:05:30.839368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 574/1134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:30 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:31.856576 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e45eaafb-0444-4346-9011-d6c7e6eb4247 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:31.857175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e45eaafb-0444-4346-9011-d6c7e6eb4247 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:31.864304 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e45eaafb-0444-4346-9011-d6c7e6eb4247 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:31.864735 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e45eaafb-0444-4346-9011-d6c7e6eb4247 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:31.865498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e45eaafb-0444-4346-9011-d6c7e6eb4247 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:31.865968 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e45eaafb-0444-4346-9011-d6c7e6eb4247 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:32.011581 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e45eaafb-0444-4346-9011-d6c7e6eb4247 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:32.024576 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e45eaafb-0444-4346-9011-d6c7e6eb4247 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.171526 Jun 21 16:05:32.025360 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 561/1135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:31 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:32.830633 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e928019d-5e07-49a0-b8be-ada00e2dbcc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:32.831204 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e928019d-5e07-49a0-b8be-ada00e2dbcc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:32.833675 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:32.834367 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=6 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:32.841105 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e928019d-5e07-49a0-b8be-ada00e2dbcc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:32.841555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e928019d-5e07-49a0-b8be-ada00e2dbcc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:32.842337 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e928019d-5e07-49a0-b8be-ada00e2dbcc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:32.842774 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e928019d-5e07-49a0-b8be-ada00e2dbcc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:32.928076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-e928019d-5e07-49a0-b8be-ada00e2dbcc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'services' on Instance uuid b7ab9a81-3476-46df-85c7-3cf8b2cf8682 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:05:33.005157 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:33.017374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e928019d-5e07-49a0-b8be-ada00e2dbcc7 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments/34a28d4c-e1b7-471c-bd88-13a6784b6313" status: 202 len: 0 microversion: 2.1 time: 0.190663 Jun 21 16:05:33.018287 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 575/1136] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jun 21 16:05:32 2022] DELETE /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments/34a28d4c-e1b7-471c-bd88-13a6784b6313 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:05:33.023919 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:33.031878 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a3335811-368e-4b51-8f87-31d73a6b36d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:33.032824 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a3335811-368e-4b51-8f87-31d73a6b36d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:33.039354 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a3335811-368e-4b51-8f87-31d73a6b36d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:33.040251 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a3335811-368e-4b51-8f87-31d73a6b36d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:33.040715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a3335811-368e-4b51-8f87-31d73a6b36d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:33.041173 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a3335811-368e-4b51-8f87-31d73a6b36d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:33.048350 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fd0e13ef-7229-4f8a-9f47-ad94ce5b476a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:33.049144 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fd0e13ef-7229-4f8a-9f47-ad94ce5b476a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:33.057374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fd0e13ef-7229-4f8a-9f47-ad94ce5b476a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:33.057850 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fd0e13ef-7229-4f8a-9f47-ad94ce5b476a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:33.058645 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fd0e13ef-7229-4f8a-9f47-ad94ce5b476a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:33.059072 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fd0e13ef-7229-4f8a-9f47-ad94ce5b476a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:33.074858 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a3335811-368e-4b51-8f87-31d73a6b36d8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051913 Jun 21 16:05:33.075456 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 562/1137] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:33 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:33.196797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fd0e13ef-7229-4f8a-9f47-ad94ce5b476a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:33.204777 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fd0e13ef-7229-4f8a-9f47-ad94ce5b476a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.162124 Jun 21 16:05:33.205383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 576/1138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:33 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:34.088120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0dabed38-c03d-4725-b718-e3a1ed296258 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:34.089037 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0dabed38-c03d-4725-b718-e3a1ed296258 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:34.096185 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0dabed38-c03d-4725-b718-e3a1ed296258 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:34.096667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0dabed38-c03d-4725-b718-e3a1ed296258 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:34.097498 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0dabed38-c03d-4725-b718-e3a1ed296258 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:34.098034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0dabed38-c03d-4725-b718-e3a1ed296258 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:34.127909 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0dabed38-c03d-4725-b718-e3a1ed296258 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Jun 21 16:05:34.128931 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 563/1139] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:34 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:34.222012 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-899a3a09-5a5e-4c1e-9d83-1934136d0d38 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:34.222722 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-899a3a09-5a5e-4c1e-9d83-1934136d0d38 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:34.229658 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-899a3a09-5a5e-4c1e-9d83-1934136d0d38 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:34.230131 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-899a3a09-5a5e-4c1e-9d83-1934136d0d38 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:34.230901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-899a3a09-5a5e-4c1e-9d83-1934136d0d38 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:34.231333 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-899a3a09-5a5e-4c1e-9d83-1934136d0d38 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:34.385136 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-899a3a09-5a5e-4c1e-9d83-1934136d0d38 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:34.397498 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-899a3a09-5a5e-4c1e-9d83-1934136d0d38 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.179542 Jun 21 16:05:34.398351 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 577/1140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:34 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:35.142922 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9a144d87-a85c-4797-b099-5975e7b9fd42 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:35.143774 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9a144d87-a85c-4797-b099-5975e7b9fd42 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:35.152228 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9a144d87-a85c-4797-b099-5975e7b9fd42 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:35.152679 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9a144d87-a85c-4797-b099-5975e7b9fd42 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:35.153442 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9a144d87-a85c-4797-b099-5975e7b9fd42 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:35.153903 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9a144d87-a85c-4797-b099-5975e7b9fd42 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:35.157624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:35.187511 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9a144d87-a85c-4797-b099-5975e7b9fd42 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050978 Jun 21 16:05:35.188073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 564/1141] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:35 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:35.421327 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-020d5953-e478-4f46-a8b4-a62cef7c7222 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:35.422088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-020d5953-e478-4f46-a8b4-a62cef7c7222 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:35.430074 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-020d5953-e478-4f46-a8b4-a62cef7c7222 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:35.430517 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-020d5953-e478-4f46-a8b4-a62cef7c7222 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:35.431277 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-020d5953-e478-4f46-a8b4-a62cef7c7222 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:35.432071 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-020d5953-e478-4f46-a8b4-a62cef7c7222 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:35.588955 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-020d5953-e478-4f46-a8b4-a62cef7c7222 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:35.597295 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-020d5953-e478-4f46-a8b4-a62cef7c7222 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.180886 Jun 21 16:05:35.597876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 578/1142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:35 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:36.203726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c3954e74-609c-4268-a666-6bd952e443e2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:36.204847 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c3954e74-609c-4268-a666-6bd952e443e2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:36.212065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c3954e74-609c-4268-a666-6bd952e443e2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:36.212511 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c3954e74-609c-4268-a666-6bd952e443e2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:36.213264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c3954e74-609c-4268-a666-6bd952e443e2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:36.213692 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c3954e74-609c-4268-a666-6bd952e443e2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:36.244605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c3954e74-609c-4268-a666-6bd952e443e2 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047702 Jun 21 16:05:36.245179 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 565/1143] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:36 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:36.620805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2ac56b42-b99c-4b1c-9de1-ba2a0660e804 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:36.621315 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2ac56b42-b99c-4b1c-9de1-ba2a0660e804 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:36.627820 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ac56b42-b99c-4b1c-9de1-ba2a0660e804 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:36.629029 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ac56b42-b99c-4b1c-9de1-ba2a0660e804 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:36.629814 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ac56b42-b99c-4b1c-9de1-ba2a0660e804 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:36.630393 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2ac56b42-b99c-4b1c-9de1-ba2a0660e804 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:36.773747 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2ac56b42-b99c-4b1c-9de1-ba2a0660e804 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:36.781460 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2ac56b42-b99c-4b1c-9de1-ba2a0660e804 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.165213 Jun 21 16:05:36.782032 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 579/1144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:36 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:37.256787 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a8b9c268-a5b8-4d33-a6e7-f07a10460988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:37.257715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a8b9c268-a5b8-4d33-a6e7-f07a10460988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:37.264825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a8b9c268-a5b8-4d33-a6e7-f07a10460988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:37.265268 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a8b9c268-a5b8-4d33-a6e7-f07a10460988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:37.266038 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a8b9c268-a5b8-4d33-a6e7-f07a10460988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:37.266491 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a8b9c268-a5b8-4d33-a6e7-f07a10460988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:37.298385 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a8b9c268-a5b8-4d33-a6e7-f07a10460988 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Jun 21 16:05:37.298858 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 566/1145] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:37 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:37.799190 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8187b536-12fd-4d17-9578-e9529cb27f85 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:37.799767 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8187b536-12fd-4d17-9578-e9529cb27f85 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:37.807756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8187b536-12fd-4d17-9578-e9529cb27f85 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:37.808205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8187b536-12fd-4d17-9578-e9529cb27f85 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:37.808951 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8187b536-12fd-4d17-9578-e9529cb27f85 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:37.809378 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8187b536-12fd-4d17-9578-e9529cb27f85 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:37.960446 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8187b536-12fd-4d17-9578-e9529cb27f85 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:37.968340 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8187b536-12fd-4d17-9578-e9529cb27f85 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.173126 Jun 21 16:05:37.968944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 580/1146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:37 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:38.314582 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-44ad35a4-e292-40e0-bd1c-099fd8fdd986 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:38.315653 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-44ad35a4-e292-40e0-bd1c-099fd8fdd986 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:38.322728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-44ad35a4-e292-40e0-bd1c-099fd8fdd986 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:38.323171 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-44ad35a4-e292-40e0-bd1c-099fd8fdd986 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:38.323928 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-44ad35a4-e292-40e0-bd1c-099fd8fdd986 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:38.324349 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-44ad35a4-e292-40e0-bd1c-099fd8fdd986 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:38.354701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-44ad35a4-e292-40e0-bd1c-099fd8fdd986 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046663 Jun 21 16:05:38.355244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 567/1147] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:38 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:38.986426 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-7a4b75e9-d719-476d-9d2b-44a7a0edf79e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:38.987108 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-7a4b75e9-d719-476d-9d2b-44a7a0edf79e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:38.997806 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7a4b75e9-d719-476d-9d2b-44a7a0edf79e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:38.998598 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7a4b75e9-d719-476d-9d2b-44a7a0edf79e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:38.999874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7a4b75e9-d719-476d-9d2b-44a7a0edf79e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:39.000602 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-7a4b75e9-d719-476d-9d2b-44a7a0edf79e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:39.138473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-7a4b75e9-d719-476d-9d2b-44a7a0edf79e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:39.147771 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-7a4b75e9-d719-476d-9d2b-44a7a0edf79e tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.165143 Jun 21 16:05:39.158161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 581/1148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:38 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:39.366346 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-600d5eea-4d49-4969-a9e2-d8e964057907 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:39.367259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-600d5eea-4d49-4969-a9e2-d8e964057907 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:39.374382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-600d5eea-4d49-4969-a9e2-d8e964057907 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:39.374825 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-600d5eea-4d49-4969-a9e2-d8e964057907 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:39.375573 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-600d5eea-4d49-4969-a9e2-d8e964057907 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:39.375996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-600d5eea-4d49-4969-a9e2-d8e964057907 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:39.408370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-600d5eea-4d49-4969-a9e2-d8e964057907 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046308 Jun 21 16:05:39.408924 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 568/1149] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:39 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:40.168027 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-753e3f3a-b034-42c8-9ec7-9592e8b5a9ec tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:40.168715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-753e3f3a-b034-42c8-9ec7-9592e8b5a9ec tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:40.177371 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-753e3f3a-b034-42c8-9ec7-9592e8b5a9ec tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:40.177808 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-753e3f3a-b034-42c8-9ec7-9592e8b5a9ec tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:40.178606 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-753e3f3a-b034-42c8-9ec7-9592e8b5a9ec tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:40.179039 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-753e3f3a-b034-42c8-9ec7-9592e8b5a9ec tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:40.340137 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-753e3f3a-b034-42c8-9ec7-9592e8b5a9ec tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:40.348528 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-753e3f3a-b034-42c8-9ec7-9592e8b5a9ec tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.185863 Jun 21 16:05:40.349145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 582/1150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:40 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:40.420695 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-4a62f4ed-f4a2-4ef6-83a2-237c877b577d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:40.421672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-4a62f4ed-f4a2-4ef6-83a2-237c877b577d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:40.428193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a62f4ed-f4a2-4ef6-83a2-237c877b577d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:40.428629 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a62f4ed-f4a2-4ef6-83a2-237c877b577d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:40.429573 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a62f4ed-f4a2-4ef6-83a2-237c877b577d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:40.430061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-4a62f4ed-f4a2-4ef6-83a2-237c877b577d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:40.460805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-4a62f4ed-f4a2-4ef6-83a2-237c877b577d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Jun 21 16:05:40.461373 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 569/1151] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:40 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:41.365541 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2f7abdb3-3ed2-48ed-a8d0-c946c5e612fd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:41.366200 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2f7abdb3-3ed2-48ed-a8d0-c946c5e612fd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:41.373433 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2f7abdb3-3ed2-48ed-a8d0-c946c5e612fd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:41.373944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2f7abdb3-3ed2-48ed-a8d0-c946c5e612fd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:41.374720 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2f7abdb3-3ed2-48ed-a8d0-c946c5e612fd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:41.375164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2f7abdb3-3ed2-48ed-a8d0-c946c5e612fd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:41.523963 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2f7abdb3-3ed2-48ed-a8d0-c946c5e612fd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:41.531644 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2f7abdb3-3ed2-48ed-a8d0-c946c5e612fd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.170724 Jun 21 16:05:41.532224 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 583/1152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:41 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:41.685943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-98d1b8f5-d8fe-43df-b9fa-09aa1410b464 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:41.687128 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-98d1b8f5-d8fe-43df-b9fa-09aa1410b464 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:41.694564 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98d1b8f5-d8fe-43df-b9fa-09aa1410b464 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:41.695115 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98d1b8f5-d8fe-43df-b9fa-09aa1410b464 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:41.695945 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98d1b8f5-d8fe-43df-b9fa-09aa1410b464 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:41.696453 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-98d1b8f5-d8fe-43df-b9fa-09aa1410b464 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:41.727694 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-98d1b8f5-d8fe-43df-b9fa-09aa1410b464 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259096 Jun 21 16:05:41.728274 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 570/1153] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:41 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:42.548618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-aad90849-73b1-456b-8130-9d65387b010d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:42.549212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-aad90849-73b1-456b-8130-9d65387b010d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:42.556164 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aad90849-73b1-456b-8130-9d65387b010d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:42.556603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aad90849-73b1-456b-8130-9d65387b010d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:42.557365 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aad90849-73b1-456b-8130-9d65387b010d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:42.557825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-aad90849-73b1-456b-8130-9d65387b010d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:42.700474 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-aad90849-73b1-456b-8130-9d65387b010d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:42.712763 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-aad90849-73b1-456b-8130-9d65387b010d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.167711 Jun 21 16:05:42.713578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 584/1154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:42 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:42.741554 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-51e29fef-ec54-46e5-b297-f69ba167bc94 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:42.742542 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-51e29fef-ec54-46e5-b297-f69ba167bc94 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:42.751907 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51e29fef-ec54-46e5-b297-f69ba167bc94 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:42.752520 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51e29fef-ec54-46e5-b297-f69ba167bc94 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:42.754015 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51e29fef-ec54-46e5-b297-f69ba167bc94 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:42.754463 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-51e29fef-ec54-46e5-b297-f69ba167bc94 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:42.783214 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-51e29fef-ec54-46e5-b297-f69ba167bc94 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046921 Jun 21 16:05:42.783768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 571/1155] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jun 21 16:05:42 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:05:42.841284 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-260a531a-257a-48eb-923a-3dd38ba5a42c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:42.841715 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-260a531a-257a-48eb-923a-3dd38ba5a42c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:42.848957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-260a531a-257a-48eb-923a-3dd38ba5a42c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:42.849437 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-260a531a-257a-48eb-923a-3dd38ba5a42c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:42.850296 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-260a531a-257a-48eb-923a-3dd38ba5a42c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:42.850707 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-260a531a-257a-48eb-923a-3dd38ba5a42c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:42.877122 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-260a531a-257a-48eb-923a-3dd38ba5a42c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:05:42.966048 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-260a531a-257a-48eb-923a-3dd38ba5a42c tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 204 len: 0 microversion: 2.1 time: 0.128125 Jun 21 16:05:42.966927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 585/1156] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:05:42 2022] DELETE /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:05:42.976623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9cabbb01-bcfb-47df-ad2f-278c5c371391 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:42.977231 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9cabbb01-bcfb-47df-ad2f-278c5c371391 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:42.983278 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9cabbb01-bcfb-47df-ad2f-278c5c371391 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:42.983707 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9cabbb01-bcfb-47df-ad2f-278c5c371391 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:42.984686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9cabbb01-bcfb-47df-ad2f-278c5c371391 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:42.985072 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9cabbb01-bcfb-47df-ad2f-278c5c371391 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:43.131356 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-9cabbb01-bcfb-47df-ad2f-278c5c371391 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:43.143198 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9cabbb01-bcfb-47df-ad2f-278c5c371391 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1680 microversion: 2.1 time: 0.171337 Jun 21 16:05:43.144035 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 572/1157] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:42 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:05:43.733871 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c988514e-905f-4737-bab2-9e28925a0f29 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:43.734622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c988514e-905f-4737-bab2-9e28925a0f29 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:43.738525 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:43.742159 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c988514e-905f-4737-bab2-9e28925a0f29 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:43.742596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c988514e-905f-4737-bab2-9e28925a0f29 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:43.743344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c988514e-905f-4737-bab2-9e28925a0f29 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:43.743766 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c988514e-905f-4737-bab2-9e28925a0f29 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:43.888893 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c988514e-905f-4737-bab2-9e28925a0f29 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:43.898094 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c988514e-905f-4737-bab2-9e28925a0f29 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.168405 Jun 21 16:05:43.898655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 586/1158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:43 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:44.162877 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e126d009-ffc5-4b89-9c7b-0d08f1ff4327 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:44.163557 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e126d009-ffc5-4b89-9c7b-0d08f1ff4327 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:44.166959 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:44.171046 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e126d009-ffc5-4b89-9c7b-0d08f1ff4327 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:44.171577 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e126d009-ffc5-4b89-9c7b-0d08f1ff4327 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:44.172347 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e126d009-ffc5-4b89-9c7b-0d08f1ff4327 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:44.172757 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e126d009-ffc5-4b89-9c7b-0d08f1ff4327 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:44.311353 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e126d009-ffc5-4b89-9c7b-0d08f1ff4327 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:44.319206 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e126d009-ffc5-4b89-9c7b-0d08f1ff4327 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1680 microversion: 2.1 time: 0.160502 Jun 21 16:05:44.319777 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 573/1159] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:44 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:44.915546 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d647931d-fb50-4891-9331-ac3fa6701f2f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:44.916245 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d647931d-fb50-4891-9331-ac3fa6701f2f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:44.922195 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d647931d-fb50-4891-9331-ac3fa6701f2f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:44.922635 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d647931d-fb50-4891-9331-ac3fa6701f2f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:44.923374 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d647931d-fb50-4891-9331-ac3fa6701f2f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:44.923801 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d647931d-fb50-4891-9331-ac3fa6701f2f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:45.146353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d647931d-fb50-4891-9331-ac3fa6701f2f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:45.160723 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d647931d-fb50-4891-9331-ac3fa6701f2f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.249170 Jun 21 16:05:45.174522 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 587/1160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:44 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:45.337762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e6ff9df5-6560-466e-a7e7-3437f5d3da36 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:45.338484 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e6ff9df5-6560-466e-a7e7-3437f5d3da36 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:45.345620 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6ff9df5-6560-466e-a7e7-3437f5d3da36 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:45.346101 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6ff9df5-6560-466e-a7e7-3437f5d3da36 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:45.346871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6ff9df5-6560-466e-a7e7-3437f5d3da36 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:45.347295 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e6ff9df5-6560-466e-a7e7-3437f5d3da36 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:45.553697 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e6ff9df5-6560-466e-a7e7-3437f5d3da36 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:45.561552 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e6ff9df5-6560-466e-a7e7-3437f5d3da36 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1680 microversion: 2.1 time: 0.228581 Jun 21 16:05:45.571854 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 574/1161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:45 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:46.018902 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-ee2f36cf-8d32-4b5e-80da-e7921391aeb3 req-893cbfa5-bea9-4129-b80b-a92c4dae50ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ab9a81-3476-46df-85c7-3cf8b2cf8682", "name": "network-vif-deleted", "tag": "e4b17c80-6acf-43ca-a73a-47b97676a4fc"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:46.028365 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-ee2f36cf-8d32-4b5e-80da-e7921391aeb3 req-893cbfa5-bea9-4129-b80b-a92c4dae50ab service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:46.029023 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-ee2f36cf-8d32-4b5e-80da-e7921391aeb3 req-893cbfa5-bea9-4129-b80b-a92c4dae50ab service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:46.059161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-ee2f36cf-8d32-4b5e-80da-e7921391aeb3 req-893cbfa5-bea9-4129-b80b-a92c4dae50ab service nova] Creating event network-vif-deleted:e4b17c80-6acf-43ca-a73a-47b97676a4fc for instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 on hv-cinder-84067 Jun 21 16:05:46.063359 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-ee2f36cf-8d32-4b5e-80da-e7921391aeb3 req-893cbfa5-bea9-4129-b80b-a92c4dae50ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048186 Jun 21 16:05:46.067192 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 588/1162] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:46.196704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-f2a7afc1-28ac-43ab-ac0a-f5da73d2902b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:46.197736 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-f2a7afc1-28ac-43ab-ac0a-f5da73d2902b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:46.207780 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f2a7afc1-28ac-43ab-ac0a-f5da73d2902b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:46.208909 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f2a7afc1-28ac-43ab-ac0a-f5da73d2902b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:46.212018 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f2a7afc1-28ac-43ab-ac0a-f5da73d2902b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:46.212796 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-f2a7afc1-28ac-43ab-ac0a-f5da73d2902b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:46.423799 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-f2a7afc1-28ac-43ab-ac0a-f5da73d2902b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:46.432001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-f2a7afc1-28ac-43ab-ac0a-f5da73d2902b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.248647 Jun 21 16:05:46.432614 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 575/1163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:46 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:46.580925 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:46.581626 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:46.588324 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:46.588769 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:46.589534 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:46.589989 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:46.622888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:46.622888 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:46.623132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'fault' on Instance uuid b7ab9a81-3476-46df-85c7-3cf8b2cf8682 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:05:46.665175 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:46.672902 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3aa5a11b-f2a6-499f-898b-ee4e055ec2a5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1330 microversion: 2.1 time: 0.096667 Jun 21 16:05:46.673487 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 589/1164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:46 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:46.693404 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-90ab737f-584b-4077-9f13-58bd2fc7fe9b req-d87720a2-9b31-4647-a454-0df274d83e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f8c983-c477-4e4e-9849-b32ce457ae59", "name": "network-vif-plugged", "status": "completed", "tag": "0713c871-4f3f-44fa-9891-a72dde86a445"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:46.701547 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-90ab737f-584b-4077-9f13-58bd2fc7fe9b req-d87720a2-9b31-4647-a454-0df274d83e8d service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:46.702010 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-90ab737f-584b-4077-9f13-58bd2fc7fe9b req-d87720a2-9b31-4647-a454-0df274d83e8d service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:46.714299 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-90ab737f-584b-4077-9f13-58bd2fc7fe9b req-d87720a2-9b31-4647-a454-0df274d83e8d service nova] Creating event network-vif-plugged:0713c871-4f3f-44fa-9891-a72dde86a445 for instance 85f8c983-c477-4e4e-9849-b32ce457ae59 on hv-cinder-84067 Jun 21 16:05:46.719300 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-90ab737f-584b-4077-9f13-58bd2fc7fe9b req-d87720a2-9b31-4647-a454-0df274d83e8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029713 Jun 21 16:05:46.719885 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 576/1165] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:47.449287 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8bfdaa30-e6a8-4e2b-a6c8-94fdc3ab0ba7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:47.449984 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8bfdaa30-e6a8-4e2b-a6c8-94fdc3ab0ba7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:47.456577 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8bfdaa30-e6a8-4e2b-a6c8-94fdc3ab0ba7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:47.457193 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8bfdaa30-e6a8-4e2b-a6c8-94fdc3ab0ba7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:47.458107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8bfdaa30-e6a8-4e2b-a6c8-94fdc3ab0ba7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:47.458780 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8bfdaa30-e6a8-4e2b-a6c8-94fdc3ab0ba7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:47.605036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8bfdaa30-e6a8-4e2b-a6c8-94fdc3ab0ba7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:47.616125 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8bfdaa30-e6a8-4e2b-a6c8-94fdc3ab0ba7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.171143 Jun 21 16:05:47.616671 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 590/1166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:47 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:47.691285 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:47.692133 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:47.698947 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:47.699390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:47.700146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:47.700574 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:47.733380 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:47.733848 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:47.734288 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'fault' on Instance uuid b7ab9a81-3476-46df-85c7-3cf8b2cf8682 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:05:47.778890 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:47.789155 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-a694fede-446a-4c8c-9bc0-587e16a6c004 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1330 microversion: 2.1 time: 0.102537 Jun 21 16:05:47.789690 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 577/1167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:47 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:48.636929 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-59d58341-23b5-4617-8f37-7e9bfba0459f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:48.637628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-59d58341-23b5-4617-8f37-7e9bfba0459f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:48.644595 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59d58341-23b5-4617-8f37-7e9bfba0459f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:48.645207 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59d58341-23b5-4617-8f37-7e9bfba0459f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:48.646165 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59d58341-23b5-4617-8f37-7e9bfba0459f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:48.646707 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-59d58341-23b5-4617-8f37-7e9bfba0459f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:48.651478 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:48.808947 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:48.809884 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:48.817526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:48.818281 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:48.819142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:48.819624 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:48.824632 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-59d58341-23b5-4617-8f37-7e9bfba0459f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:48.833372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-59d58341-23b5-4617-8f37-7e9bfba0459f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.200263 Jun 21 16:05:48.834076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 591/1168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:48 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:48.853555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:48.854035 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:48.854476 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'fault' on Instance uuid b7ab9a81-3476-46df-85c7-3cf8b2cf8682 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:05:48.907671 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:48.919718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e388804a-3fdf-469c-834e-b95a59f9759f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1330 microversion: 2.1 time: 0.115900 Jun 21 16:05:48.920691 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 578/1169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:48 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:49.852892 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-cdbe3d02-7301-461b-abd9-98a41e28529a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:49.853504 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-cdbe3d02-7301-461b-abd9-98a41e28529a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:49.861345 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cdbe3d02-7301-461b-abd9-98a41e28529a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:49.862071 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cdbe3d02-7301-461b-abd9-98a41e28529a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:49.862842 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cdbe3d02-7301-461b-abd9-98a41e28529a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:49.863264 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-cdbe3d02-7301-461b-abd9-98a41e28529a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:49.943041 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:49.943717 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:49.950038 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:49.950482 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:49.951271 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:49.951682 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:49.984826 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:49.985264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:49.985713 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.objects.instance [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lazy-loading 'fault' on Instance uuid b7ab9a81-3476-46df-85c7-3cf8b2cf8682 {{(pid=123939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:05:50.020205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-cdbe3d02-7301-461b-abd9-98a41e28529a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:50.029096 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-cdbe3d02-7301-461b-abd9-98a41e28529a tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.180825 Jun 21 16:05:50.029655 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 592/1170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:49 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:50.037345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67a5c4b7034d22b78331b907cc20bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20d29454c00499282eb86547eeb4c10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:50.045675 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-45babe83-b1a5-4ae1-b7a9-a9683b19b314 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 200 len: 1330 microversion: 2.1 time: 0.107406 Jun 21 16:05:50.046296 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 579/1171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:49 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:51.047196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8542eeb4-016f-416f-882d-cebcc793c80c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:51.047809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8542eeb4-016f-416f-882d-cebcc793c80c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:51.055308 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8542eeb4-016f-416f-882d-cebcc793c80c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:51.055800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8542eeb4-016f-416f-882d-cebcc793c80c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:51.056640 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8542eeb4-016f-416f-882d-cebcc793c80c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:51.057087 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8542eeb4-016f-416f-882d-cebcc793c80c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:51.063521 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:51.064119 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:51.071174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:51.071615 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:51.072374 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:51.072804 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:51.087839 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 HTTP/1.1 Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:51.089609 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:51.091142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'b7ab9a81-3476-46df-85c7-3cf8b2cf8682'} Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:51.091948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:51.093370 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:51.095566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:51.095566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-6e6c82b1-92dc-4173-a85a-31e5190a48ea tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 404 len: 111 microversion: 2.1 time: 0.031478 Jun 21 16:05:51.095566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 580/1172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:51 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:51.101109 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9e862fd8-fdcb-454d-a40f-80a44c47d829 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '.version_select at 0x7f73b7bf8a60>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:51.120860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9e862fd8-fdcb-454d-a40f-80a44c47d829 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757059273" status: 202 len: 0 microversion: 2.1 time: 0.023040 Jun 21 16:05:51.120860 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 581/1173] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Jun 21 16:05:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757059273 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:05:51.234679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8542eeb4-016f-416f-882d-cebcc793c80c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:51.242902 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8542eeb4-016f-416f-882d-cebcc793c80c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1264 microversion: 2.1 time: 0.199790 Jun 21 16:05:51.243489 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 593/1174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:51 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:52.260518 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-13a3aae9-34cd-4db7-9974-542554e464e7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:52.261238 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-13a3aae9-34cd-4db7-9974-542554e464e7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:52.271006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13a3aae9-34cd-4db7-9974-542554e464e7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:52.271569 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13a3aae9-34cd-4db7-9974-542554e464e7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:52.272389 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13a3aae9-34cd-4db7-9974-542554e464e7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:52.272820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-13a3aae9-34cd-4db7-9974-542554e464e7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:52.276947 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=100 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:52.439260 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-13a3aae9-34cd-4db7-9974-542554e464e7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:52.447644 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-13a3aae9-34cd-4db7-9974-542554e464e7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1451 microversion: 2.1 time: 0.191564 Jun 21 16:05:52.448201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 582/1175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:52 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1451 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:52.466131 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-df8697ee-219f-4265-98b9-ad8748a4ac09 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:52.466699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-df8697ee-219f-4265-98b9-ad8748a4ac09 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:52.476368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-df8697ee-219f-4265-98b9-ad8748a4ac09 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:52.476815 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-df8697ee-219f-4265-98b9-ad8748a4ac09 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:52.477698 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-df8697ee-219f-4265-98b9-ad8748a4ac09 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:52.478186 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-df8697ee-219f-4265-98b9-ad8748a4ac09 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:52.626944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-df8697ee-219f-4265-98b9-ad8748a4ac09 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:05:52.637324 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-df8697ee-219f-4265-98b9-ad8748a4ac09 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1451 microversion: 2.1 time: 0.177033 Jun 21 16:05:52.638114 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 594/1176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:52 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:05:54.592576 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-d5ef22f2-ec39-4c8d-887a-3d97fa40e2a6 req-7c8b4294-6fbc-4233-91ae-8e7c3589293b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f8c983-c477-4e4e-9849-b32ce457ae59", "tag": "0713c871-4f3f-44fa-9891-a72dde86a445"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:05:54.608593 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-d5ef22f2-ec39-4c8d-887a-3d97fa40e2a6 req-7c8b4294-6fbc-4233-91ae-8e7c3589293b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:54.609036 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-d5ef22f2-ec39-4c8d-887a-3d97fa40e2a6 req-7c8b4294-6fbc-4233-91ae-8e7c3589293b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:54.620677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-d5ef22f2-ec39-4c8d-887a-3d97fa40e2a6 req-7c8b4294-6fbc-4233-91ae-8e7c3589293b service nova] Creating event network-changed:0713c871-4f3f-44fa-9891-a72dde86a445 for instance 85f8c983-c477-4e4e-9849-b32ce457ae59 on hv-cinder-84067 Jun 21 16:05:54.626165 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-d5ef22f2-ec39-4c8d-887a-3d97fa40e2a6 req-7c8b4294-6fbc-4233-91ae-8e7c3589293b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037893 Jun 21 16:05:54.626789 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 583/1177] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:05:56.134882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:56.135410 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:56.142078 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:56.142532 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:56.143298 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:56.143731 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:56.157551 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 HTTP/1.1 Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:05:56.159268 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.160809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'b7ab9a81-3476-46df-85c7-3cf8b2cf8682'} Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:56.161934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.163690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.165699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:56.165699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fe893bef-f75c-479d-9319-f75582240654 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 404 len: 111 microversion: 2.1 time: 0.029878 Jun 21 16:05:56.165699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 595/1178] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:05:56 2022] DELETE /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:56.176145 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:56.177055 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: b7ab9a81-3476-46df-85c7-3cf8b2cf8682] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:56.183266 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:56.183696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:56.184517 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:56.184948 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:56.198939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 HTTP/1.1 Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:56.200508 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.202006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'b7ab9a81-3476-46df-85c7-3cf8b2cf8682'} Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:56.202762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. Jun 21 16:05:56.203944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:56.205875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance b7ab9a81-3476-46df-85c7-3cf8b2cf8682 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:56.205875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ee3110bf-5058-4ca6-8997-1d4219ca5ab8 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682" status: 404 len: 111 microversion: 2.1 time: 0.030596 Jun 21 16:05:56.205875 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 584/1179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:56 2022] GET /compute/v2.1/servers/b7ab9a81-3476-46df-85c7-3cf8b2cf8682 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:57.340767 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:57.341344 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:57.348615 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:57.349062 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:57.350153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:57.350337 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:57.364475 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 HTTP/1.1 Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:05:57.366107 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.367520 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '5c4c7c0a-54a2-4047-85b8-13456b2fb6b7'} Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:57.371601 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.373121 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.374790 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:57.374790 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-20c54621-4c06-4a8a-8f9c-385642c0ec3d tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 404 len: 111 microversion: 2.1 time: 0.030890 Jun 21 16:05:57.374790 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 596/1180] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:05:57 2022] DELETE /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:57.376152 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:57.376754 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:57.383369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:57.383807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:57.384550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:57.384974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:57.400988 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 HTTP/1.1 Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:57.402641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.404259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '5c4c7c0a-54a2-4047-85b8-13456b2fb6b7'} Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:57.405114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. Jun 21 16:05:57.406623 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.408336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:57.408336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c029cd5f-82be-4e07-acc8-ae71e2f78ef5 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7" status: 404 len: 111 microversion: 2.1 time: 0.031817 Jun 21 16:05:57.408336 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 585/1181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:57 2022] GET /compute/v2.1/servers/5c4c7c0a-54a2-4047-85b8-13456b2fb6b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:57.414514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:57.415033 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:57.422365 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:57.422835 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:57.423599 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:57.424027 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:57.438135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 HTTP/1.1 Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:05:57.439681 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.441249 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '8e069614-4aff-4e07-841c-31317d94f447'} Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:57.442129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.444288 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.447069 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:57.447069 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-30eaec30-5ffa-4903-8429-065eba020022 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 404 len: 111 microversion: 2.1 time: 0.031159 Jun 21 16:05:57.447069 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 597/1182] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:05:57 2022] DELETE /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:57.449682 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:57.450317 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 8e069614-4aff-4e07-841c-31317d94f447] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:57.456743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:57.457189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:57.457979 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:57.459016 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:57.472735 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 HTTP/1.1 Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:57.474743 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.476400 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '8e069614-4aff-4e07-841c-31317d94f447'} Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:57.477186 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. Jun 21 16:05:57.478745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:57.480504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 8e069614-4aff-4e07-841c-31317d94f447 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:57.480504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-93076ea5-df2b-46e7-abe1-1d33f06b469b tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447" status: 404 len: 111 microversion: 2.1 time: 0.030127 Jun 21 16:05:57.480504 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 586/1183] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:57 2022] GET /compute/v2.1/servers/8e069614-4aff-4e07-841c-31317d94f447 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:58.621470 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:58.622043 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:58.629248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:58.629689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:58.630682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:58.631232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:58.647750 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: DELETE /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 HTTP/1.1 Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:05:58.649290 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.650912 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '0dd1f66a-f226-49c0-8f07-54b3c9abc2c2'} Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:58.651882 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.653603 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.656205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:58.656205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-5bb9f542-ea9d-418e-9554-d84881a41b43 tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 404 len: 111 microversion: 2.1 time: 0.033153 Jun 21 16:05:58.656205 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 598/1184] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:05:58 2022] DELETE /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:58.664651 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:05:58.665369 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] [instance: 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:05:58.675064 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:58.675701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:58.676888 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:05:58.677506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:05:58.691926 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] HTTP exception thrown: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Request method failure captured: Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 HTTP/1.1 Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABisemITr8ZSWA26r24a28Kg23Nn9FrgfrZIqOk0KFRCa9DqnDUL2K6kAPTufkK7cV0zantfnnqNiTPtZwwDhRkgtdPBtGMCWrjONhiT-Q40jhbyFcMIDPibkCA3DSdB1UTm9PNT-uuWgVo7D0kM78ynqAB0ofK591q5DjFjMhuqkqOE6Y Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:05:58.693565 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d20d29454c00499282eb86547eeb4c10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d20d29454c00499282eb86547eeb4c10", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: d20d29454c00499282eb86547eeb4c10 Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-42368156 Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 9a67a5c4b7034d22b78331b907cc20bc Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-AttachVolumeNegativeTest-42368156-project Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.695426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '0dd1f66a-f226-49c0-8f07-54b3c9abc2c2'} Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:05:58.696331 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. Jun 21 16:05:58.697807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:05:58.699138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] Returning 404 to user: Instance 0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:05:58.699138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-30a10c6c-15b4-4ba7-90eb-35ff7e04519f tempest-AttachVolumeNegativeTest-42368156 tempest-AttachVolumeNegativeTest-42368156-project] 10.222.0.52 "GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2" status: 404 len: 111 microversion: 2.1 time: 0.036832 Jun 21 16:05:58.699138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 587/1185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:05:58 2022] GET /compute/v2.1/servers/0dd1f66a-f226-49c0-8f07-54b3c9abc2c2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:07:04.528809 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=27 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:04.529635 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=30 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:04.763003 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-3781c5c7-1763-431f-8198-30363ff55a4b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Action: 'create', calling method: .version_select at 0x7f73b610c820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1305804171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoNXmdP7Pzl/El19uIftvqIakWO606Khf8kKZfBOq9IIget+mGh1LYQstxOmBx7BUAQ7UVRXvQ4uZo5qh+7YqrMbGbEtTOVopSYbweaJsnQ7Oeve6oNQdU+WyY1ndjnpg=="}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:07:04.780611 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-3781c5c7-1763-431f-8198-30363ff55a4b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Getting quotas for project 4016a8a7626d4aa5a28d248a5a799e8e. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:07:04.784618 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.quota [None req-3781c5c7-1763-431f-8198-30363ff55a4b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Getting quotas for user 8617fdc3e63446c89fcd22bd5756109d and project 4016a8a7626d4aa5a28d248a5a799e8e. Resources: {'key_pairs'} {{(pid=123938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:07:04.817545 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-3781c5c7-1763-431f-8198-30363ff55a4b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.290396 Jun 21 16:07:04.818476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 599/1186] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jun 21 16:07:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:07:14.496200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:07:14.496827 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Tue Jun 21 16:07:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:07:27.445454 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:27.446278 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=14 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:27.450244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-642680217", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1305804171", "security_groups": [{"name": "tempest-secgroup-smoke-2062060189"}], "networks": [{"uuid": "9d6cb5b7-04b9-473e-97a1-7608cd65ca11"}], "block_device_mapping_v2": [{"uuid": "201b1481-3599-4196-b54e-ad242bf6a3ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:07:27.575602 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] validate_networks() for [('9d6cb5b7-04b9-473e-97a1-7608cd65ca11', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:07:28.069247 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:07:28.069669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:07:28.070155 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:07:28.070551 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:07:28.070951 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:07:28.081045 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:28.081497 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:28.082313 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:28.082718 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:28.100918 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Getting quotas for project 4016a8a7626d4aa5a28d248a5a799e8e. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:07:28.105398 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Getting quotas for user 8617fdc3e63446c89fcd22bd5756109d and project 4016a8a7626d4aa5a28d248a5a799e8e. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:07:28.166175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:07:28.168388 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='201b1481-3599-4196-b54e-ad242bf6a3ff',volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:07:28.329514 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e71a29d9-60b9-4072-b442-27ad1a902c12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.885297 Jun 21 16:07:28.335605 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 588/1187] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:07:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:07:28.338412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=4 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:28.340819 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:28.344924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e69e0065-f9b4-4f49-89a6-65bede004d51 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:28.345943 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e69e0065-f9b4-4f49-89a6-65bede004d51 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:28.420808 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e69e0065-f9b4-4f49-89a6-65bede004d51 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:28.428561 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e69e0065-f9b4-4f49-89a6-65bede004d51 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1088 microversion: 2.1 time: 0.091558 Jun 21 16:07:28.429230 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 600/1188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:28 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1088 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:29.447214 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-03557e6e-5c1e-49d8-8224-692978df05a3 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:29.448480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-03557e6e-5c1e-49d8-8224-692978df05a3 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:29.456054 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-03557e6e-5c1e-49d8-8224-692978df05a3 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:29.456880 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-03557e6e-5c1e-49d8-8224-692978df05a3 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:29.458315 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-03557e6e-5c1e-49d8-8224-692978df05a3 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:29.459189 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-03557e6e-5c1e-49d8-8224-692978df05a3 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:29.871382 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-03557e6e-5c1e-49d8-8224-692978df05a3 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:29.882049 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-03557e6e-5c1e-49d8-8224-692978df05a3 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1194 microversion: 2.1 time: 0.439417 Jun 21 16:07:29.883075 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 589/1189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:29 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:30.902755 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e459259b-f576-4839-b808-4907ffbbb629 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:30.903372 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e459259b-f576-4839-b808-4907ffbbb629 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:30.911862 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e459259b-f576-4839-b808-4907ffbbb629 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:30.912304 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e459259b-f576-4839-b808-4907ffbbb629 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:30.913507 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e459259b-f576-4839-b808-4907ffbbb629 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:30.913943 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e459259b-f576-4839-b808-4907ffbbb629 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:31.159535 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-e459259b-f576-4839-b808-4907ffbbb629 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:31.167564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e459259b-f576-4839-b808-4907ffbbb629 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.272002 Jun 21 16:07:31.168216 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 601/1190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:30 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:31.691270 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-fd9fb916-bff6-4117-a27e-ba3791e5a8de req-d81ae5cd-f101-4bf6-88e4-3d5e7340f486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475bce88-8d72-4c08-b431-f5987c6b95a0", "tag": "b9276118-8bc8-43ec-a759-26c8224ec857"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:07:31.707680 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-fd9fb916-bff6-4117-a27e-ba3791e5a8de req-d81ae5cd-f101-4bf6-88e4-3d5e7340f486 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:31.708967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-fd9fb916-bff6-4117-a27e-ba3791e5a8de req-d81ae5cd-f101-4bf6-88e4-3d5e7340f486 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:31.730808 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-fd9fb916-bff6-4117-a27e-ba3791e5a8de req-d81ae5cd-f101-4bf6-88e4-3d5e7340f486 service nova] Creating event network-changed:b9276118-8bc8-43ec-a759-26c8224ec857 for instance 475bce88-8d72-4c08-b431-f5987c6b95a0 on hv-cinder-84067 Jun 21 16:07:31.739323 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-fd9fb916-bff6-4117-a27e-ba3791e5a8de req-d81ae5cd-f101-4bf6-88e4-3d5e7340f486 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259082 Jun 21 16:07:31.740256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 590/1191] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:07:32.185576 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a3516059-9a8d-4d09-8c42-0d210e8b1ee7 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:32.186493 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a3516059-9a8d-4d09-8c42-0d210e8b1ee7 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:32.194054 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a3516059-9a8d-4d09-8c42-0d210e8b1ee7 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:32.194473 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a3516059-9a8d-4d09-8c42-0d210e8b1ee7 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:32.195253 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a3516059-9a8d-4d09-8c42-0d210e8b1ee7 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:32.195679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a3516059-9a8d-4d09-8c42-0d210e8b1ee7 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:32.401932 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a3516059-9a8d-4d09-8c42-0d210e8b1ee7 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:32.411002 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a3516059-9a8d-4d09-8c42-0d210e8b1ee7 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.229295 Jun 21 16:07:32.411648 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 602/1192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:32 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:33.435641 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-fedec70b-623d-4466-b28b-ed1b6ce8e1ee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:33.436473 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-fedec70b-623d-4466-b28b-ed1b6ce8e1ee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:33.443655 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fedec70b-623d-4466-b28b-ed1b6ce8e1ee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:33.444233 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fedec70b-623d-4466-b28b-ed1b6ce8e1ee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:33.445085 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fedec70b-623d-4466-b28b-ed1b6ce8e1ee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:33.445573 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-fedec70b-623d-4466-b28b-ed1b6ce8e1ee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:33.598734 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-fedec70b-623d-4466-b28b-ed1b6ce8e1ee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:33.613024 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-fedec70b-623d-4466-b28b-ed1b6ce8e1ee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.187613 Jun 21 16:07:33.613523 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 591/1193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:33 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:34.631036 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f9fbc138-1460-4a6a-99c0-0f9ddceb8e17 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:34.631620 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f9fbc138-1460-4a6a-99c0-0f9ddceb8e17 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:34.637996 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f9fbc138-1460-4a6a-99c0-0f9ddceb8e17 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:34.638445 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f9fbc138-1460-4a6a-99c0-0f9ddceb8e17 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:34.639185 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f9fbc138-1460-4a6a-99c0-0f9ddceb8e17 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:34.639631 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f9fbc138-1460-4a6a-99c0-0f9ddceb8e17 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:34.783129 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f9fbc138-1460-4a6a-99c0-0f9ddceb8e17 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:34.792187 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f9fbc138-1460-4a6a-99c0-0f9ddceb8e17 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.165583 Jun 21 16:07:34.792761 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 603/1194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:34 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:35.809156 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8241859b-2027-4cb2-ac43-ce0d0be221fd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:35.810353 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8241859b-2027-4cb2-ac43-ce0d0be221fd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:35.817512 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8241859b-2027-4cb2-ac43-ce0d0be221fd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:35.817973 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8241859b-2027-4cb2-ac43-ce0d0be221fd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:35.818726 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8241859b-2027-4cb2-ac43-ce0d0be221fd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:35.819160 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8241859b-2027-4cb2-ac43-ce0d0be221fd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:35.967174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-8241859b-2027-4cb2-ac43-ce0d0be221fd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:35.975528 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8241859b-2027-4cb2-ac43-ce0d0be221fd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.170482 Jun 21 16:07:35.976097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 592/1195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:35 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:36.996829 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-25ccdaa5-0673-4025-b672-20fede0fa76a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:36.997405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-25ccdaa5-0673-4025-b672-20fede0fa76a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:37.004196 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-25ccdaa5-0673-4025-b672-20fede0fa76a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:37.004628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-25ccdaa5-0673-4025-b672-20fede0fa76a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:37.005403 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-25ccdaa5-0673-4025-b672-20fede0fa76a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:37.005880 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-25ccdaa5-0673-4025-b672-20fede0fa76a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:37.190649 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-25ccdaa5-0673-4025-b672-20fede0fa76a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:37.199363 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-25ccdaa5-0673-4025-b672-20fede0fa76a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.206019 Jun 21 16:07:37.200231 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 604/1196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:36 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:38.216920 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-43d36145-a0c2-497b-91fc-6801e8acb3d6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:38.217612 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-43d36145-a0c2-497b-91fc-6801e8acb3d6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:38.220138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:38.220810 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=6 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:38.228318 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-43d36145-a0c2-497b-91fc-6801e8acb3d6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:38.228762 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-43d36145-a0c2-497b-91fc-6801e8acb3d6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:38.229566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-43d36145-a0c2-497b-91fc-6801e8acb3d6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:38.230135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-43d36145-a0c2-497b-91fc-6801e8acb3d6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:38.378745 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-43d36145-a0c2-497b-91fc-6801e8acb3d6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:38.387259 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-43d36145-a0c2-497b-91fc-6801e8acb3d6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.174267 Jun 21 16:07:38.387854 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 593/1197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:38 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:39.407214 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d4d22dc7-4843-43a8-bd6c-d0c702963c98 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:39.407966 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d4d22dc7-4843-43a8-bd6c-d0c702963c98 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:39.411780 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:39.419875 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d4d22dc7-4843-43a8-bd6c-d0c702963c98 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:39.420543 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d4d22dc7-4843-43a8-bd6c-d0c702963c98 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:39.421866 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d4d22dc7-4843-43a8-bd6c-d0c702963c98 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:39.422530 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d4d22dc7-4843-43a8-bd6c-d0c702963c98 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:39.582354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-d4d22dc7-4843-43a8-bd6c-d0c702963c98 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:39.590342 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d4d22dc7-4843-43a8-bd6c-d0c702963c98 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.189841 Jun 21 16:07:39.590928 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 605/1198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:39 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:40.612649 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-69e43872-16ca-442a-9c99-038c2ffa6306 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:40.613335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-69e43872-16ca-442a-9c99-038c2ffa6306 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:40.622607 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-69e43872-16ca-442a-9c99-038c2ffa6306 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:40.623052 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-69e43872-16ca-442a-9c99-038c2ffa6306 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:40.623837 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-69e43872-16ca-442a-9c99-038c2ffa6306 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:40.624264 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-69e43872-16ca-442a-9c99-038c2ffa6306 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:40.764991 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-69e43872-16ca-442a-9c99-038c2ffa6306 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:40.772919 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-69e43872-16ca-442a-9c99-038c2ffa6306 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.164259 Jun 21 16:07:40.773471 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 594/1199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:40 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:41.795303 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-633e36ae-3d0a-40e7-bdad-8da639f6bd1e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:41.795911 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-633e36ae-3d0a-40e7-bdad-8da639f6bd1e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:41.803198 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-633e36ae-3d0a-40e7-bdad-8da639f6bd1e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:41.803645 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-633e36ae-3d0a-40e7-bdad-8da639f6bd1e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:41.804405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-633e36ae-3d0a-40e7-bdad-8da639f6bd1e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:41.804816 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-633e36ae-3d0a-40e7-bdad-8da639f6bd1e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:41.948477 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-633e36ae-3d0a-40e7-bdad-8da639f6bd1e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:41.956643 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-633e36ae-3d0a-40e7-bdad-8da639f6bd1e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.165390 Jun 21 16:07:41.957215 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 606/1200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:41 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:42.553394 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-2126d45e-53a3-4e6a-b568-fe91f00bfc4b req-ec6923b6-991a-45d5-bbf0-63b6062e799b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475bce88-8d72-4c08-b431-f5987c6b95a0", "name": "network-vif-plugged", "status": "completed", "tag": "b9276118-8bc8-43ec-a759-26c8224ec857"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:07:42.562128 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-2126d45e-53a3-4e6a-b568-fe91f00bfc4b req-ec6923b6-991a-45d5-bbf0-63b6062e799b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:42.562559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-2126d45e-53a3-4e6a-b568-fe91f00bfc4b req-ec6923b6-991a-45d5-bbf0-63b6062e799b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:42.574196 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-2126d45e-53a3-4e6a-b568-fe91f00bfc4b req-ec6923b6-991a-45d5-bbf0-63b6062e799b service nova] Creating event network-vif-plugged:b9276118-8bc8-43ec-a759-26c8224ec857 for instance 475bce88-8d72-4c08-b431-f5987c6b95a0 on hv-cinder-84067 Jun 21 16:07:42.579319 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-2126d45e-53a3-4e6a-b568-fe91f00bfc4b req-ec6923b6-991a-45d5-bbf0-63b6062e799b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219535 Jun 21 16:07:42.579931 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 595/1201] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:07:42.975368 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c55f9663-4025-4b1e-9b30-2c9c3f290cfd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:42.975994 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c55f9663-4025-4b1e-9b30-2c9c3f290cfd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:42.983510 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c55f9663-4025-4b1e-9b30-2c9c3f290cfd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:42.983949 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c55f9663-4025-4b1e-9b30-2c9c3f290cfd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:42.984705 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c55f9663-4025-4b1e-9b30-2c9c3f290cfd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:42.985422 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c55f9663-4025-4b1e-9b30-2c9c3f290cfd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:43.136737 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c55f9663-4025-4b1e-9b30-2c9c3f290cfd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:43.147958 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c55f9663-4025-4b1e-9b30-2c9c3f290cfd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.177042 Jun 21 16:07:43.148545 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 607/1202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:42 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:44.166555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-52535d15-00e2-4b01-abe7-9e6fd933f969 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:44.167135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-52535d15-00e2-4b01-abe7-9e6fd933f969 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:44.174426 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52535d15-00e2-4b01-abe7-9e6fd933f969 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:44.174865 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52535d15-00e2-4b01-abe7-9e6fd933f969 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:44.175617 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52535d15-00e2-4b01-abe7-9e6fd933f969 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:44.176053 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-52535d15-00e2-4b01-abe7-9e6fd933f969 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:44.330753 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-52535d15-00e2-4b01-abe7-9e6fd933f969 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:44.338992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-52535d15-00e2-4b01-abe7-9e6fd933f969 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1260 microversion: 2.1 time: 0.177613 Jun 21 16:07:44.339584 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 596/1203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:44 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:45.361073 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8be2ddc8-3587-48a0-9329-342a91fde986 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:45.362126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8be2ddc8-3587-48a0-9329-342a91fde986 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:45.371461 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8be2ddc8-3587-48a0-9329-342a91fde986 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:45.371923 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8be2ddc8-3587-48a0-9329-342a91fde986 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:45.372696 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8be2ddc8-3587-48a0-9329-342a91fde986 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:45.373128 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8be2ddc8-3587-48a0-9329-342a91fde986 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:45.517274 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-8be2ddc8-3587-48a0-9329-342a91fde986 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:45.527568 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8be2ddc8-3587-48a0-9329-342a91fde986 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1443 microversion: 2.1 time: 0.173491 Jun 21 16:07:45.528135 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 608/1204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:45 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:45.544460 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-66432c44-6141-4878-99b6-a061b7440fee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:07:45.545065 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-66432c44-6141-4878-99b6-a061b7440fee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:07:45.552213 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-66432c44-6141-4878-99b6-a061b7440fee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:45.552651 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-66432c44-6141-4878-99b6-a061b7440fee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:45.553395 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-66432c44-6141-4878-99b6-a061b7440fee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:45.554058 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-66432c44-6141-4878-99b6-a061b7440fee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:45.705064 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-66432c44-6141-4878-99b6-a061b7440fee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:07:45.715212 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-66432c44-6141-4878-99b6-a061b7440fee tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1443 microversion: 2.1 time: 0.175133 Jun 21 16:07:45.715805 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 597/1205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:07:45 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:07:47.911638 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-66f12fc9-f15a-47de-b601-da4cc1be028d req-201c8ff6-92ab-4e41-b086-6fcc5efc9dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475bce88-8d72-4c08-b431-f5987c6b95a0", "tag": "b9276118-8bc8-43ec-a759-26c8224ec857"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:07:47.923628 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-66f12fc9-f15a-47de-b601-da4cc1be028d req-201c8ff6-92ab-4e41-b086-6fcc5efc9dbe service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:07:47.924165 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-66f12fc9-f15a-47de-b601-da4cc1be028d req-201c8ff6-92ab-4e41-b086-6fcc5efc9dbe service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:07:47.940264 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-66f12fc9-f15a-47de-b601-da4cc1be028d req-201c8ff6-92ab-4e41-b086-6fcc5efc9dbe service nova] Creating event network-changed:b9276118-8bc8-43ec-a759-26c8224ec857 for instance 475bce88-8d72-4c08-b431-f5987c6b95a0 on hv-cinder-84067 Jun 21 16:07:47.947428 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-66f12fc9-f15a-47de-b601-da4cc1be028d req-201c8ff6-92ab-4e41-b086-6fcc5efc9dbe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039534 Jun 21 16:07:47.948046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 609/1206] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:08:37.541357 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-953294886", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-877953109", "security_groups": [{"name": "tempest-secgroup-smoke-930699362"}], "block_device_mapping_v2": [{"uuid": "8ce41f7b-3e09-4d49-8365-192bb146e4cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "394d887b-9dbe-47a5-a600-3a263ed9e0b8"}]}} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:08:37.549802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:37.550447 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=48 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:37.743920 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.network.neutron [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] validate_networks() for [('394d887b-9dbe-47a5-a600-3a263ed9e0b8', None, None, None, None, None)] {{(pid=123939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:08:38.141387 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Flavor limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:08:38.141842 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Image limits 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:08:38.142317 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Flavor pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:08:38.142723 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Image pref 0:0:0 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:08:38.143130 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.virt.hardware [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:08:38.153146 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:38.153589 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:38.154415 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:38.154853 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:38.178512 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Getting quotas for project 658a35680c70498db2bccc1085c22b21. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:08:38.182791 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.quota [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Getting quotas for user 0943474b3d4d49d7973619388dab2be1 and project 658a35680c70498db2bccc1085c22b21. Resources: {'cores', 'instances', 'ram'} {{(pid=123939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:08:38.242062 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Going to run 1 instances... {{(pid=123939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:08:38.244183 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ce41f7b-3e09-4d49-8365-192bb146e4cf',volume_size=None,volume_type=None)] {{(pid=123939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:08:38.392601 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-35dab555-1109-4d73-b747-da83f13593d2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.855442 Jun 21 16:08:38.393190 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 598/1207] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jun 21 16:08:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:08:38.404435 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4dc17a40-f5f6-4d6e-b24f-107c3f8aa1c0 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:38.405104 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4dc17a40-f5f6-4d6e-b24f-107c3f8aa1c0 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:38.410064 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=22 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:38.410699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=50 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:38.523044 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4dc17a40-f5f6-4d6e-b24f-107c3f8aa1c0 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:38.531141 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4dc17a40-f5f6-4d6e-b24f-107c3f8aa1c0 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1093 microversion: 2.1 time: 0.131296 Jun 21 16:08:38.531967 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 610/1208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:38 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1093 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:39.549666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ee2bdbef-1bdc-4133-8e01-e41130d27e66 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:39.550440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ee2bdbef-1bdc-4133-8e01-e41130d27e66 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:39.556585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee2bdbef-1bdc-4133-8e01-e41130d27e66 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:39.557022 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee2bdbef-1bdc-4133-8e01-e41130d27e66 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:39.557985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee2bdbef-1bdc-4133-8e01-e41130d27e66 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:39.558588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ee2bdbef-1bdc-4133-8e01-e41130d27e66 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:39.629200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ee2bdbef-1bdc-4133-8e01-e41130d27e66 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:39.637525 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ee2bdbef-1bdc-4133-8e01-e41130d27e66 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1209 microversion: 2.1 time: 0.092377 Jun 21 16:08:39.638338 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 599/1209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:39 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:40.655758 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-691be86f-eb19-4cb9-b0b9-34264fcb6b9f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:40.656723 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-691be86f-eb19-4cb9-b0b9-34264fcb6b9f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:40.664286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-691be86f-eb19-4cb9-b0b9-34264fcb6b9f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:40.664736 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-691be86f-eb19-4cb9-b0b9-34264fcb6b9f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:40.665514 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-691be86f-eb19-4cb9-b0b9-34264fcb6b9f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:40.665972 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-691be86f-eb19-4cb9-b0b9-34264fcb6b9f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:40.888459 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-2cbfd976-d882-4f41-90ef-3f6b6a98b786 req-85fe7e56-2565-459d-8dba-4b502bd7bde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a09126a-29a2-4e4f-ac02-9778a4e9ee3d", "tag": "f004a60c-9f07-4f6e-b147-72121cb96d03"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:08:40.895497 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-691be86f-eb19-4cb9-b0b9-34264fcb6b9f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:40.908501 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-2cbfd976-d882-4f41-90ef-3f6b6a98b786 req-85fe7e56-2565-459d-8dba-4b502bd7bde6 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:40.908939 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-2cbfd976-d882-4f41-90ef-3f6b6a98b786 req-85fe7e56-2565-459d-8dba-4b502bd7bde6 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:40.913699 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-691be86f-eb19-4cb9-b0b9-34264fcb6b9f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.261606 Jun 21 16:08:40.914990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 611/1210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:40 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:40.929700 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-2cbfd976-d882-4f41-90ef-3f6b6a98b786 req-85fe7e56-2565-459d-8dba-4b502bd7bde6 service nova] Creating event network-changed:f004a60c-9f07-4f6e-b147-72121cb96d03 for instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d on hv-cinder-84067 Jun 21 16:08:40.935802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-2cbfd976-d882-4f41-90ef-3f6b6a98b786 req-85fe7e56-2565-459d-8dba-4b502bd7bde6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051503 Jun 21 16:08:40.936672 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 600/1211] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:08:41.934524 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dac0304f-5f4b-4c41-98ea-f894fc2e4a0f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:41.935158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dac0304f-5f4b-4c41-98ea-f894fc2e4a0f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:41.942179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dac0304f-5f4b-4c41-98ea-f894fc2e4a0f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:41.942619 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dac0304f-5f4b-4c41-98ea-f894fc2e4a0f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:41.943370 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dac0304f-5f4b-4c41-98ea-f894fc2e4a0f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:41.943798 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dac0304f-5f4b-4c41-98ea-f894fc2e4a0f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:42.084521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dac0304f-5f4b-4c41-98ea-f894fc2e4a0f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:42.093132 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dac0304f-5f4b-4c41-98ea-f894fc2e4a0f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.164553 Jun 21 16:08:42.093673 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 612/1212] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:41 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:43.116675 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-26926ad7-20f7-4014-9f68-90098d91f01c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:43.117296 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-26926ad7-20f7-4014-9f68-90098d91f01c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:43.124518 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-26926ad7-20f7-4014-9f68-90098d91f01c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:43.124955 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-26926ad7-20f7-4014-9f68-90098d91f01c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:43.125703 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-26926ad7-20f7-4014-9f68-90098d91f01c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:43.126153 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-26926ad7-20f7-4014-9f68-90098d91f01c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:43.274684 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-26926ad7-20f7-4014-9f68-90098d91f01c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:43.282617 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-26926ad7-20f7-4014-9f68-90098d91f01c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.170786 Jun 21 16:08:43.283177 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 601/1213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:43 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:44.302953 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-a28ed0f5-1d24-427c-b5cc-40fcb3f348c4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:44.303897 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-a28ed0f5-1d24-427c-b5cc-40fcb3f348c4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:44.315309 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a28ed0f5-1d24-427c-b5cc-40fcb3f348c4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:44.316042 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a28ed0f5-1d24-427c-b5cc-40fcb3f348c4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:44.317218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a28ed0f5-1d24-427c-b5cc-40fcb3f348c4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:44.317998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-a28ed0f5-1d24-427c-b5cc-40fcb3f348c4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:44.459472 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-a28ed0f5-1d24-427c-b5cc-40fcb3f348c4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:44.471789 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-a28ed0f5-1d24-427c-b5cc-40fcb3f348c4 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.174441 Jun 21 16:08:44.471789 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 613/1214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:44 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:45.492868 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-dec61644-3cd6-4938-a7fb-2f394725f758 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:45.493978 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-dec61644-3cd6-4938-a7fb-2f394725f758 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:45.503151 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dec61644-3cd6-4938-a7fb-2f394725f758 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:45.503513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dec61644-3cd6-4938-a7fb-2f394725f758 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:45.504280 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dec61644-3cd6-4938-a7fb-2f394725f758 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:45.504706 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-dec61644-3cd6-4938-a7fb-2f394725f758 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:45.653879 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-dec61644-3cd6-4938-a7fb-2f394725f758 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:45.662340 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-dec61644-3cd6-4938-a7fb-2f394725f758 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.175851 Jun 21 16:08:45.662917 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 602/1215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:45 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:46.679759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-f883be7f-fbf0-40ca-9967-0bd07ad937c9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:46.680624 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-f883be7f-fbf0-40ca-9967-0bd07ad937c9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:46.687570 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f883be7f-fbf0-40ca-9967-0bd07ad937c9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:46.688013 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f883be7f-fbf0-40ca-9967-0bd07ad937c9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:46.688796 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f883be7f-fbf0-40ca-9967-0bd07ad937c9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:46.689231 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-f883be7f-fbf0-40ca-9967-0bd07ad937c9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:46.836153 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-f883be7f-fbf0-40ca-9967-0bd07ad937c9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:46.848234 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-f883be7f-fbf0-40ca-9967-0bd07ad937c9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.172461 Jun 21 16:08:46.848844 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 614/1216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:46 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:47.866082 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-db6bab28-3942-46b9-abb0-9c1d2275015b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:47.866715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-db6bab28-3942-46b9-abb0-9c1d2275015b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:47.874006 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-db6bab28-3942-46b9-abb0-9c1d2275015b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:47.874535 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-db6bab28-3942-46b9-abb0-9c1d2275015b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:47.875301 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-db6bab28-3942-46b9-abb0-9c1d2275015b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:47.875736 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-db6bab28-3942-46b9-abb0-9c1d2275015b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:48.016861 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-db6bab28-3942-46b9-abb0-9c1d2275015b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:48.026180 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-db6bab28-3942-46b9-abb0-9c1d2275015b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.164146 Jun 21 16:08:48.026741 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 603/1217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:47 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:49.044874 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-302c0e5f-db41-4814-b528-83ce8993771f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:49.045703 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-302c0e5f-db41-4814-b528-83ce8993771f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:49.048056 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell0:SELECT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:49.054269 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-302c0e5f-db41-4814-b528-83ce8993771f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:49.054759 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-302c0e5f-db41-4814-b528-83ce8993771f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:49.055557 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-302c0e5f-db41-4814-b528-83ce8993771f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:49.055991 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-302c0e5f-db41-4814-b528-83ce8993771f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:49.225539 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-302c0e5f-db41-4814-b528-83ce8993771f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:49.236131 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-302c0e5f-db41-4814-b528-83ce8993771f tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.194497 Jun 21 16:08:49.238183 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 615/1218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:49 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:50.255882 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d1bff189-faca-4c4d-bff1-e9b808b9ea8b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:50.256503 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d1bff189-faca-4c4d-bff1-e9b808b9ea8b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:50.258555 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=2 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:50.259210 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell0:SELECT=6 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:50.266256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1bff189-faca-4c4d-bff1-e9b808b9ea8b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:50.266482 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1bff189-faca-4c4d-bff1-e9b808b9ea8b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:50.267257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1bff189-faca-4c4d-bff1-e9b808b9ea8b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:50.267686 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d1bff189-faca-4c4d-bff1-e9b808b9ea8b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:50.413996 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d1bff189-faca-4c4d-bff1-e9b808b9ea8b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:50.422648 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d1bff189-faca-4c4d-bff1-e9b808b9ea8b tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.171213 Jun 21 16:08:50.423402 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 604/1219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:50 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:50.684018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-fd3cdc81-9167-4d3a-bf15-2d250c89341e req-991ff8c9-986d-40ea-9caf-3580432c4424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a09126a-29a2-4e4f-ac02-9778a4e9ee3d", "name": "network-vif-plugged", "status": "completed", "tag": "f004a60c-9f07-4f6e-b147-72121cb96d03"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:08:50.693588 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-fd3cdc81-9167-4d3a-bf15-2d250c89341e req-991ff8c9-986d-40ea-9caf-3580432c4424 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:50.694251 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-fd3cdc81-9167-4d3a-bf15-2d250c89341e req-991ff8c9-986d-40ea-9caf-3580432c4424 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:50.707765 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.compute.server_external_events [req-fd3cdc81-9167-4d3a-bf15-2d250c89341e req-991ff8c9-986d-40ea-9caf-3580432c4424 service nova] Creating event network-vif-plugged:f004a60c-9f07-4f6e-b147-72121cb96d03 for instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d on hv-cinder-84067 Jun 21 16:08:50.713567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-fd3cdc81-9167-4d3a-bf15-2d250c89341e req-991ff8c9-986d-40ea-9caf-3580432c4424 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033445 Jun 21 16:08:50.714361 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 616/1220] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:08:51.288660 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:08:51.289292 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Tue Jun 21 16:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:08:51.443596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0541c0d2-8b31-4135-acac-9c64b9a57786 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:51.444190 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0541c0d2-8b31-4135-acac-9c64b9a57786 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:51.451733 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0541c0d2-8b31-4135-acac-9c64b9a57786 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:51.452174 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0541c0d2-8b31-4135-acac-9c64b9a57786 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:51.453135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0541c0d2-8b31-4135-acac-9c64b9a57786 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:51.453566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0541c0d2-8b31-4135-acac-9c64b9a57786 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:51.604286 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0541c0d2-8b31-4135-acac-9c64b9a57786 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:51.614983 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0541c0d2-8b31-4135-acac-9c64b9a57786 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.174992 Jun 21 16:08:51.615643 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 605/1221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:51 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:52.636756 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-2e5d0f42-4c40-41f4-95c8-f220882ee6dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:52.637452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-2e5d0f42-4c40-41f4-95c8-f220882ee6dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:52.645622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2e5d0f42-4c40-41f4-95c8-f220882ee6dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:52.646095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2e5d0f42-4c40-41f4-95c8-f220882ee6dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:52.646865 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2e5d0f42-4c40-41f4-95c8-f220882ee6dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:52.647297 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-2e5d0f42-4c40-41f4-95c8-f220882ee6dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:52.793873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-2e5d0f42-4c40-41f4-95c8-f220882ee6dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:52.801755 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-2e5d0f42-4c40-41f4-95c8-f220882ee6dd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1264 microversion: 2.1 time: 0.170107 Jun 21 16:08:52.802322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 617/1222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:52 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:53.822772 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-1ad1038e-3177-43ea-a133-05a13ed1669d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:53.823406 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-1ad1038e-3177-43ea-a133-05a13ed1669d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:53.832654 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ad1038e-3177-43ea-a133-05a13ed1669d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:53.833054 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ad1038e-3177-43ea-a133-05a13ed1669d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:53.833929 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ad1038e-3177-43ea-a133-05a13ed1669d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:53.834329 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-1ad1038e-3177-43ea-a133-05a13ed1669d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:53.979390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-1ad1038e-3177-43ea-a133-05a13ed1669d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:53.990998 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-1ad1038e-3177-43ea-a133-05a13ed1669d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1452 microversion: 2.1 time: 0.173681 Jun 21 16:08:53.992120 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 606/1223] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:53 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:54.016267 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-b4c62f6f-c590-4519-bb5c-4eaef4ef2512 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:08:54.017066 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-b4c62f6f-c590-4519-bb5c-4eaef4ef2512 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:08:54.023998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b4c62f6f-c590-4519-bb5c-4eaef4ef2512 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:54.024415 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b4c62f6f-c590-4519-bb5c-4eaef4ef2512 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:54.025409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b4c62f6f-c590-4519-bb5c-4eaef4ef2512 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:54.025873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-b4c62f6f-c590-4519-bb5c-4eaef4ef2512 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:54.467783 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-b4c62f6f-c590-4519-bb5c-4eaef4ef2512 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:08:54.476742 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-b4c62f6f-c590-4519-bb5c-4eaef4ef2512 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1452 microversion: 2.1 time: 0.465979 Jun 21 16:08:54.489026 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 618/1224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:08:54 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1452 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:08:56.342165 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-f2d7735a-ed85-4b8a-a3a1-316f160db0a5 req-f1429cf8-d422-4e6c-9880-99082f2fbe73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a09126a-29a2-4e4f-ac02-9778a4e9ee3d", "tag": "f004a60c-9f07-4f6e-b147-72121cb96d03"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:08:56.350992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-f2d7735a-ed85-4b8a-a3a1-316f160db0a5 req-f1429cf8-d422-4e6c-9880-99082f2fbe73 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:08:56.351697 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-f2d7735a-ed85-4b8a-a3a1-316f160db0a5 req-f1429cf8-d422-4e6c-9880-99082f2fbe73 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:08:56.363644 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-f2d7735a-ed85-4b8a-a3a1-316f160db0a5 req-f1429cf8-d422-4e6c-9880-99082f2fbe73 service nova] Creating event network-changed:f004a60c-9f07-4f6e-b147-72121cb96d03 for instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d on hv-cinder-84067 Jun 21 16:08:56.368818 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-f2d7735a-ed85-4b8a-a3a1-316f160db0a5 req-f1429cf8-d422-4e6c-9880-99082f2fbe73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030494 Jun 21 16:08:56.369465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 607/1225] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:10:12.231320 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=20 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:12.232076 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=44 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:12.236911 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-50d652b7-1b9e-4f91-a1c1-d456859f2795 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:10:12.237462 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-50d652b7-1b9e-4f91-a1c1-d456859f2795 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:12.244580 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-50d652b7-1b9e-4f91-a1c1-d456859f2795 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:12.245013 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-50d652b7-1b9e-4f91-a1c1-d456859f2795 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:12.245768 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-50d652b7-1b9e-4f91-a1c1-d456859f2795 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:12.246221 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-50d652b7-1b9e-4f91-a1c1-d456859f2795 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:12.269702 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-50d652b7-1b9e-4f91-a1c1-d456859f2795 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lazy-loading 'flavor' on Instance uuid 475bce88-8d72-4c08-b431-f5987c6b95a0 {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:10:12.346428 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-50d652b7-1b9e-4f91-a1c1-d456859f2795 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "POST /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0/action" status: 202 len: 0 microversion: 2.1 time: 0.117165 Jun 21 16:10:12.347022 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 619/1226] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 16:10:12 2022] POST /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:10:12.353967 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:12.354727 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=48 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:12.359916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-3379b897-1396-4bf8-92a4-bf741563165e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:12.360626 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-3379b897-1396-4bf8-92a4-bf741563165e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:12.369114 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3379b897-1396-4bf8-92a4-bf741563165e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:12.369596 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3379b897-1396-4bf8-92a4-bf741563165e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:12.370423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3379b897-1396-4bf8-92a4-bf741563165e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:12.370842 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-3379b897-1396-4bf8-92a4-bf741563165e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:12.511740 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-3379b897-1396-4bf8-92a4-bf741563165e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:12.520134 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-3379b897-1396-4bf8-92a4-bf741563165e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.168458 Jun 21 16:10:12.520719 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 608/1227] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:12 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:13.539380 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-615da307-17b5-4fdc-b5f8-7ea22e59a7fb tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:13.540046 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-615da307-17b5-4fdc-b5f8-7ea22e59a7fb tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:13.547338 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-615da307-17b5-4fdc-b5f8-7ea22e59a7fb tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:13.547805 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-615da307-17b5-4fdc-b5f8-7ea22e59a7fb tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:13.548557 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-615da307-17b5-4fdc-b5f8-7ea22e59a7fb tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:13.549011 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-615da307-17b5-4fdc-b5f8-7ea22e59a7fb tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:13.695640 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-615da307-17b5-4fdc-b5f8-7ea22e59a7fb tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:13.703792 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-615da307-17b5-4fdc-b5f8-7ea22e59a7fb tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.168916 Jun 21 16:10:13.704534 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 620/1228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:13 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:14.725372 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-e68ded4f-261e-4fcc-9745-ccc282b9bf75 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:14.726409 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-e68ded4f-261e-4fcc-9745-ccc282b9bf75 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:14.737487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e68ded4f-261e-4fcc-9745-ccc282b9bf75 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:14.737964 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e68ded4f-261e-4fcc-9745-ccc282b9bf75 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:14.738722 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e68ded4f-261e-4fcc-9745-ccc282b9bf75 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:14.739811 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-e68ded4f-261e-4fcc-9745-ccc282b9bf75 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:14.887021 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-e68ded4f-261e-4fcc-9745-ccc282b9bf75 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:14.895007 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-e68ded4f-261e-4fcc-9745-ccc282b9bf75 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.176862 Jun 21 16:10:14.895541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 609/1229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:14 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:15.913167 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ab7bf0b9-c601-4339-9f43-fd356d7f7eea tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:15.913825 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ab7bf0b9-c601-4339-9f43-fd356d7f7eea tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:15.920875 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab7bf0b9-c601-4339-9f43-fd356d7f7eea tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:15.921322 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab7bf0b9-c601-4339-9f43-fd356d7f7eea tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:15.922148 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab7bf0b9-c601-4339-9f43-fd356d7f7eea tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:15.922556 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ab7bf0b9-c601-4339-9f43-fd356d7f7eea tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:16.067429 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ab7bf0b9-c601-4339-9f43-fd356d7f7eea tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:16.075365 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ab7bf0b9-c601-4339-9f43-fd356d7f7eea tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.166323 Jun 21 16:10:16.075937 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 621/1230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:15 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:17.094821 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ddb79f6c-a80e-4f61-97d1-46cd677dd438 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:17.095433 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ddb79f6c-a80e-4f61-97d1-46cd677dd438 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:17.101953 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ddb79f6c-a80e-4f61-97d1-46cd677dd438 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:17.102390 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ddb79f6c-a80e-4f61-97d1-46cd677dd438 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:17.103138 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ddb79f6c-a80e-4f61-97d1-46cd677dd438 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:17.103559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ddb79f6c-a80e-4f61-97d1-46cd677dd438 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:17.253973 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ddb79f6c-a80e-4f61-97d1-46cd677dd438 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:17.265890 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ddb79f6c-a80e-4f61-97d1-46cd677dd438 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.176661 Jun 21 16:10:17.267091 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 610/1231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:17 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:18.291957 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-05cf2779-97c2-40b6-b7cb-29fcff0dc7d9 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:18.292533 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-05cf2779-97c2-40b6-b7cb-29fcff0dc7d9 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:18.299654 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05cf2779-97c2-40b6-b7cb-29fcff0dc7d9 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:18.300147 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05cf2779-97c2-40b6-b7cb-29fcff0dc7d9 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:18.300927 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05cf2779-97c2-40b6-b7cb-29fcff0dc7d9 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:18.301354 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-05cf2779-97c2-40b6-b7cb-29fcff0dc7d9 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:18.452652 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-05cf2779-97c2-40b6-b7cb-29fcff0dc7d9 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:18.461299 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-05cf2779-97c2-40b6-b7cb-29fcff0dc7d9 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.173296 Jun 21 16:10:18.461901 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 622/1232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:18 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:19.478989 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-ffa8184e-eff7-4bff-9448-17b32bcb708a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:19.479650 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-ffa8184e-eff7-4bff-9448-17b32bcb708a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:19.490949 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ffa8184e-eff7-4bff-9448-17b32bcb708a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:19.491669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ffa8184e-eff7-4bff-9448-17b32bcb708a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:19.492916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ffa8184e-eff7-4bff-9448-17b32bcb708a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:19.493626 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-ffa8184e-eff7-4bff-9448-17b32bcb708a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:19.639728 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-ffa8184e-eff7-4bff-9448-17b32bcb708a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:19.653391 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-ffa8184e-eff7-4bff-9448-17b32bcb708a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.178117 Jun 21 16:10:19.654184 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 611/1233] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:19 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:20.672337 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6ecf9d02-b126-490b-94c6-508a01cfa28e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:20.673253 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6ecf9d02-b126-490b-94c6-508a01cfa28e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:20.680944 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ecf9d02-b126-490b-94c6-508a01cfa28e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:20.681457 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ecf9d02-b126-490b-94c6-508a01cfa28e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:20.682778 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ecf9d02-b126-490b-94c6-508a01cfa28e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:20.683498 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6ecf9d02-b126-490b-94c6-508a01cfa28e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:20.719018 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:10:20.719456 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Tue Jun 21 16:10:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 (ip 10.222.0.52) !!! Jun 21 16:10:20.823418 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6ecf9d02-b126-490b-94c6-508a01cfa28e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:20.836323 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6ecf9d02-b126-490b-94c6-508a01cfa28e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.168307 Jun 21 16:10:20.837163 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 623/1234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:20 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:21.857011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-128a577b-79c6-4206-a5fb-2a48bc39fb37 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:21.857631 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-128a577b-79c6-4206-a5fb-2a48bc39fb37 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:21.864876 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-128a577b-79c6-4206-a5fb-2a48bc39fb37 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:21.865319 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-128a577b-79c6-4206-a5fb-2a48bc39fb37 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:21.866115 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-128a577b-79c6-4206-a5fb-2a48bc39fb37 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:21.866554 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-128a577b-79c6-4206-a5fb-2a48bc39fb37 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:22.014945 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-128a577b-79c6-4206-a5fb-2a48bc39fb37 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:22.023127 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-128a577b-79c6-4206-a5fb-2a48bc39fb37 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.170317 Jun 21 16:10:22.023709 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 612/1235] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:21 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:23.043814 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ee1baca8-59b8-42f0-822a-06bb22475584 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:23.044440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ee1baca8-59b8-42f0-822a-06bb22475584 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:23.053921 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ee1baca8-59b8-42f0-822a-06bb22475584 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:23.054405 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ee1baca8-59b8-42f0-822a-06bb22475584 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:23.055142 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ee1baca8-59b8-42f0-822a-06bb22475584 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:23.055573 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ee1baca8-59b8-42f0-822a-06bb22475584 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:23.196059 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-ee1baca8-59b8-42f0-822a-06bb22475584 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:23.203922 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ee1baca8-59b8-42f0-822a-06bb22475584 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.164013 Jun 21 16:10:23.204567 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 624/1236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:23 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:24.223481 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-2e2f5c48-5550-4de7-a997-4e6d802b376d tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:24.224053 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-2e2f5c48-5550-4de7-a997-4e6d802b376d tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:24.231613 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2e2f5c48-5550-4de7-a997-4e6d802b376d tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:24.232050 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2e2f5c48-5550-4de7-a997-4e6d802b376d tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:24.232809 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2e2f5c48-5550-4de7-a997-4e6d802b376d tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:24.233242 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-2e2f5c48-5550-4de7-a997-4e6d802b376d tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:24.367610 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-2e2f5c48-5550-4de7-a997-4e6d802b376d tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:24.375793 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-2e2f5c48-5550-4de7-a997-4e6d802b376d tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.157867 Jun 21 16:10:24.376375 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 613/1237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:24 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:25.397425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9028318e-344e-49b0-b33f-4bb15c650abd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:25.398145 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9028318e-344e-49b0-b33f-4bb15c650abd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:25.405845 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9028318e-344e-49b0-b33f-4bb15c650abd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:25.406622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9028318e-344e-49b0-b33f-4bb15c650abd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:25.407176 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9028318e-344e-49b0-b33f-4bb15c650abd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:25.407690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9028318e-344e-49b0-b33f-4bb15c650abd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:25.546685 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9028318e-344e-49b0-b33f-4bb15c650abd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:25.554596 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9028318e-344e-49b0-b33f-4bb15c650abd tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1509 microversion: 2.1 time: 0.161273 Jun 21 16:10:25.555162 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 625/1238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:25 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:25.571950 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-bcdd8812-0fb1-4fa7-adc8-19f0c1e44dc8 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:10:25.572511 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-bcdd8812-0fb1-4fa7-adc8-19f0c1e44dc8 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:25.579268 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bcdd8812-0fb1-4fa7-adc8-19f0c1e44dc8 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:25.579668 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bcdd8812-0fb1-4fa7-adc8-19f0c1e44dc8 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:25.580440 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bcdd8812-0fb1-4fa7-adc8-19f0c1e44dc8 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:25.580863 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-bcdd8812-0fb1-4fa7-adc8-19f0c1e44dc8 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:25.671224 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-bcdd8812-0fb1-4fa7-adc8-19f0c1e44dc8 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "POST /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0/action" status: 202 len: 0 microversion: 2.1 time: 0.103125 Jun 21 16:10:25.671974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 614/1239] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jun 21 16:10:25 2022] POST /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:10:25.682058 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4736f95f-44e5-43fd-833a-92a79214ff93 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:25.682385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4736f95f-44e5-43fd-833a-92a79214ff93 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:25.688868 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4736f95f-44e5-43fd-833a-92a79214ff93 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:25.689373 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4736f95f-44e5-43fd-833a-92a79214ff93 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:25.690186 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4736f95f-44e5-43fd-833a-92a79214ff93 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:25.690924 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4736f95f-44e5-43fd-833a-92a79214ff93 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:25.830689 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4736f95f-44e5-43fd-833a-92a79214ff93 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:25.839277 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4736f95f-44e5-43fd-833a-92a79214ff93 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1517 microversion: 2.1 time: 0.162175 Jun 21 16:10:25.839873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 626/1240] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:25 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:26.857378 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-b5dbc9e6-0f7a-41db-8fa9-930bb05ee6ad tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:26.858027 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-b5dbc9e6-0f7a-41db-8fa9-930bb05ee6ad tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:26.865201 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9e6-0f7a-41db-8fa9-930bb05ee6ad tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:26.865633 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9e6-0f7a-41db-8fa9-930bb05ee6ad tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:26.866534 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9e6-0f7a-41db-8fa9-930bb05ee6ad tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:26.866971 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9e6-0f7a-41db-8fa9-930bb05ee6ad tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:27.003522 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-b5dbc9e6-0f7a-41db-8fa9-930bb05ee6ad tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:27.018008 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-b5dbc9e6-0f7a-41db-8fa9-930bb05ee6ad tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1517 microversion: 2.1 time: 0.165320 Jun 21 16:10:27.018814 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 615/1241] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:26 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:27.127099 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [req-fa452a77-aece-4813-8a5e-7dca3d515486 req-8b4d91f1-3ff1-43d8-8af1-cfa9ba6d5d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475bce88-8d72-4c08-b431-f5987c6b95a0", "name": "network-vif-unplugged", "status": "completed", "tag": "b9276118-8bc8-43ec-a759-26c8224ec857"}]} {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:10:27.137241 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-fa452a77-aece-4813-8a5e-7dca3d515486 req-8b4d91f1-3ff1-43d8-8af1-cfa9ba6d5d64 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:27.137866 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [req-fa452a77-aece-4813-8a5e-7dca3d515486 req-8b4d91f1-3ff1-43d8-8af1-cfa9ba6d5d64 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:27.150876 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.compute.server_external_events [req-fa452a77-aece-4813-8a5e-7dca3d515486 req-8b4d91f1-3ff1-43d8-8af1-cfa9ba6d5d64 service nova] Unable to find a host for instance 475bce88-8d72-4c08-b431-f5987c6b95a0. Dropping event network-vif-unplugged {{(pid=123938) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 16:10:27.151521 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [req-fa452a77-aece-4813-8a5e-7dca3d515486 req-8b4d91f1-3ff1-43d8-8af1-cfa9ba6d5d64 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028494 Jun 21 16:10:27.152115 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 627/1242] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 16:10:28.036194 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-5263c7c2-cbaa-4f87-841a-b5b48598b586 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:28.036826 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-5263c7c2-cbaa-4f87-841a-b5b48598b586 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:28.043724 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5263c7c2-cbaa-4f87-841a-b5b48598b586 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:28.044166 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5263c7c2-cbaa-4f87-841a-b5b48598b586 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:28.044913 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5263c7c2-cbaa-4f87-841a-b5b48598b586 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:28.045335 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-5263c7c2-cbaa-4f87-841a-b5b48598b586 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:28.184801 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-5263c7c2-cbaa-4f87-841a-b5b48598b586 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:28.193318 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-5263c7c2-cbaa-4f87-841a-b5b48598b586 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1517 microversion: 2.1 time: 0.160989 Jun 21 16:10:28.193749 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 616/1243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:28 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:29.210990 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9e41d4b1-1839-42e3-8f36-823d55d3a31f tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:29.211647 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9e41d4b1-1839-42e3-8f36-823d55d3a31f tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:29.218240 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9e41d4b1-1839-42e3-8f36-823d55d3a31f tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:29.218682 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9e41d4b1-1839-42e3-8f36-823d55d3a31f tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:29.219452 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9e41d4b1-1839-42e3-8f36-823d55d3a31f tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:29.219873 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9e41d4b1-1839-42e3-8f36-823d55d3a31f tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:29.358427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9e41d4b1-1839-42e3-8f36-823d55d3a31f tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:29.367201 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9e41d4b1-1839-42e3-8f36-823d55d3a31f tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1517 microversion: 2.1 time: 0.160184 Jun 21 16:10:29.367797 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 628/1244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:29 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:30.385244 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c66a2f93-ce54-4bf9-bb72-382b37c22f12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:30.385884 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c66a2f93-ce54-4bf9-bb72-382b37c22f12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:30.393108 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c66a2f93-ce54-4bf9-bb72-382b37c22f12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:30.394295 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c66a2f93-ce54-4bf9-bb72-382b37c22f12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:30.395034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c66a2f93-ce54-4bf9-bb72-382b37c22f12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:30.395457 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c66a2f93-ce54-4bf9-bb72-382b37c22f12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:30.537424 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c66a2f93-ce54-4bf9-bb72-382b37c22f12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:30.545330 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c66a2f93-ce54-4bf9-bb72-382b37c22f12 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1517 microversion: 2.1 time: 0.164020 Jun 21 16:10:30.545915 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 617/1245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:30 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:31.563248 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-87e23d4f-eeae-49bb-8029-192a7b4187dc tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:31.563859 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-87e23d4f-eeae-49bb-8029-192a7b4187dc tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:31.571476 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87e23d4f-eeae-49bb-8029-192a7b4187dc tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:31.571922 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87e23d4f-eeae-49bb-8029-192a7b4187dc tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:31.572679 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87e23d4f-eeae-49bb-8029-192a7b4187dc tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:31.573101 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-87e23d4f-eeae-49bb-8029-192a7b4187dc tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:31.795694 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-87e23d4f-eeae-49bb-8029-192a7b4187dc tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:31.803852 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-87e23d4f-eeae-49bb-8029-192a7b4187dc tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.244594 Jun 21 16:10:31.804440 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 629/1246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:31 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:32.821035 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-7f69f638-24b5-4ab1-b4ff-7d899ccd7bed tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:32.821673 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-7f69f638-24b5-4ab1-b4ff-7d899ccd7bed tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:32.828585 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f69f638-24b5-4ab1-b4ff-7d899ccd7bed tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:32.829020 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f69f638-24b5-4ab1-b4ff-7d899ccd7bed tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:32.829798 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f69f638-24b5-4ab1-b4ff-7d899ccd7bed tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:32.830214 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-7f69f638-24b5-4ab1-b4ff-7d899ccd7bed tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:32.975243 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-7f69f638-24b5-4ab1-b4ff-7d899ccd7bed tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:32.983669 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-7f69f638-24b5-4ab1-b4ff-7d899ccd7bed tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.166330 Jun 21 16:10:32.984561 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 618/1247] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:32 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:33.445055 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:10:33.445693 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Tue Jun 21 16:10:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:10:34.001331 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9fe9922c-46f0-465a-87a1-9ec817110578 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:34.001985 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9fe9922c-46f0-465a-87a1-9ec817110578 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:34.009615 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9fe9922c-46f0-465a-87a1-9ec817110578 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:34.010085 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9fe9922c-46f0-465a-87a1-9ec817110578 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:34.010841 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9fe9922c-46f0-465a-87a1-9ec817110578 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:34.011270 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9fe9922c-46f0-465a-87a1-9ec817110578 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:34.146859 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9fe9922c-46f0-465a-87a1-9ec817110578 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:34.154848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9fe9922c-46f0-465a-87a1-9ec817110578 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.157538 Jun 21 16:10:34.155411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 630/1248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:33 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:35.172217 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-d9e92556-884a-442d-a22a-f4d2f77ca953 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:35.172800 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-d9e92556-884a-442d-a22a-f4d2f77ca953 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:35.180171 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9e92556-884a-442d-a22a-f4d2f77ca953 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:35.180618 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9e92556-884a-442d-a22a-f4d2f77ca953 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:35.181384 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9e92556-884a-442d-a22a-f4d2f77ca953 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:35.181815 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-d9e92556-884a-442d-a22a-f4d2f77ca953 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:35.327465 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-d9e92556-884a-442d-a22a-f4d2f77ca953 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:35.335494 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-d9e92556-884a-442d-a22a-f4d2f77ca953 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.167453 Jun 21 16:10:35.336044 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 619/1249] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:35 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:36.353179 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-4364ea52-d201-4fde-8da4-573f554b4eca tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:36.353801 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-4364ea52-d201-4fde-8da4-573f554b4eca tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:36.360608 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4364ea52-d201-4fde-8da4-573f554b4eca tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:36.361051 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4364ea52-d201-4fde-8da4-573f554b4eca tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:36.361800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4364ea52-d201-4fde-8da4-573f554b4eca tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:36.362293 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-4364ea52-d201-4fde-8da4-573f554b4eca tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:36.501151 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-4364ea52-d201-4fde-8da4-573f554b4eca tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:36.509665 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-4364ea52-d201-4fde-8da4-573f554b4eca tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.160577 Jun 21 16:10:36.510265 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 631/1250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:36 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:37.527871 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-01b943b8-4a44-4fdf-8381-99b35ef119ba tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:37.528450 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-01b943b8-4a44-4fdf-8381-99b35ef119ba tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:37.535542 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-01b943b8-4a44-4fdf-8381-99b35ef119ba tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:37.535990 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-01b943b8-4a44-4fdf-8381-99b35ef119ba tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:37.536756 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-01b943b8-4a44-4fdf-8381-99b35ef119ba tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:37.537200 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-01b943b8-4a44-4fdf-8381-99b35ef119ba tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:37.682873 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-01b943b8-4a44-4fdf-8381-99b35ef119ba tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:37.691245 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-01b943b8-4a44-4fdf-8381-99b35ef119ba tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.167345 Jun 21 16:10:37.691835 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 620/1251] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:37 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:38.708662 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-c41ca9bc-ca70-4f63-9b25-d2103ac49fa6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:38.709301 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-c41ca9bc-ca70-4f63-9b25-d2103ac49fa6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:38.716530 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c41ca9bc-ca70-4f63-9b25-d2103ac49fa6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:38.716977 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c41ca9bc-ca70-4f63-9b25-d2103ac49fa6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:38.717800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c41ca9bc-ca70-4f63-9b25-d2103ac49fa6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:38.718262 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-c41ca9bc-ca70-4f63-9b25-d2103ac49fa6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:38.858126 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-c41ca9bc-ca70-4f63-9b25-d2103ac49fa6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:38.866199 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-c41ca9bc-ca70-4f63-9b25-d2103ac49fa6 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.161744 Jun 21 16:10:38.866784 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 632/1252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:38 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:39.883559 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-cc3cb47e-aeaf-4403-9598-1d541a3ffe40 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:39.884161 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-cc3cb47e-aeaf-4403-9598-1d541a3ffe40 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:39.891117 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cc3cb47e-aeaf-4403-9598-1d541a3ffe40 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:39.891590 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cc3cb47e-aeaf-4403-9598-1d541a3ffe40 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:39.892344 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cc3cb47e-aeaf-4403-9598-1d541a3ffe40 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:39.892775 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-cc3cb47e-aeaf-4403-9598-1d541a3ffe40 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:40.032557 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-cc3cb47e-aeaf-4403-9598-1d541a3ffe40 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:40.040707 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-cc3cb47e-aeaf-4403-9598-1d541a3ffe40 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.161154 Jun 21 16:10:40.041287 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 621/1253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:39 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:41.058190 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-63263e59-95db-4a27-a6f4-e15a3382d719 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:41.058853 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-63263e59-95db-4a27-a6f4-e15a3382d719 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:41.066492 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-63263e59-95db-4a27-a6f4-e15a3382d719 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:41.066938 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-63263e59-95db-4a27-a6f4-e15a3382d719 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:41.067810 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-63263e59-95db-4a27-a6f4-e15a3382d719 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:41.068227 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-63263e59-95db-4a27-a6f4-e15a3382d719 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:41.203544 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-63263e59-95db-4a27-a6f4-e15a3382d719 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:41.212146 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-63263e59-95db-4a27-a6f4-e15a3382d719 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.157833 Jun 21 16:10:41.212749 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 633/1254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:41 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:41.235774 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-e563247c-be66-42fc-aa8f-0705d61cb59b req-e37e4ccd-e6ea-4592-9498-16207d9bd86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475bce88-8d72-4c08-b431-f5987c6b95a0", "name": "network-vif-plugged", "status": "completed", "tag": "b9276118-8bc8-43ec-a759-26c8224ec857"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:10:41.246279 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-e563247c-be66-42fc-aa8f-0705d61cb59b req-e37e4ccd-e6ea-4592-9498-16207d9bd86f service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:41.247001 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-e563247c-be66-42fc-aa8f-0705d61cb59b req-e37e4ccd-e6ea-4592-9498-16207d9bd86f service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:41.260480 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-e563247c-be66-42fc-aa8f-0705d61cb59b req-e37e4ccd-e6ea-4592-9498-16207d9bd86f service nova] Creating event network-vif-plugged:b9276118-8bc8-43ec-a759-26c8224ec857 for instance 475bce88-8d72-4c08-b431-f5987c6b95a0 on hv-cinder-84067 Jun 21 16:10:41.265702 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-e563247c-be66-42fc-aa8f-0705d61cb59b req-e37e4ccd-e6ea-4592-9498-16207d9bd86f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034541 Jun 21 16:10:41.266753 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 622/1255] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:10:42.231386 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0afc4ef9-445b-4948-8ed1-512bcbdc9e26 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:42.232035 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0afc4ef9-445b-4948-8ed1-512bcbdc9e26 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:42.239144 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0afc4ef9-445b-4948-8ed1-512bcbdc9e26 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:42.239590 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0afc4ef9-445b-4948-8ed1-512bcbdc9e26 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:42.240359 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0afc4ef9-445b-4948-8ed1-512bcbdc9e26 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:42.240773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0afc4ef9-445b-4948-8ed1-512bcbdc9e26 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:42.245079 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:42.380846 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0afc4ef9-445b-4948-8ed1-512bcbdc9e26 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:42.388848 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0afc4ef9-445b-4948-8ed1-512bcbdc9e26 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1575 microversion: 2.1 time: 0.161832 Jun 21 16:10:42.389411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 634/1256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:42 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:43.408773 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-21bb3f76-0c6e-47cc-8bcd-aa779aa51c04 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:43.409606 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-21bb3f76-0c6e-47cc-8bcd-aa779aa51c04 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:43.411832 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=33 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:43.417786 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21bb3f76-0c6e-47cc-8bcd-aa779aa51c04 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:43.418220 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21bb3f76-0c6e-47cc-8bcd-aa779aa51c04 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:43.418985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21bb3f76-0c6e-47cc-8bcd-aa779aa51c04 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:43.419417 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-21bb3f76-0c6e-47cc-8bcd-aa779aa51c04 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:43.422289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:43.561721 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-21bb3f76-0c6e-47cc-8bcd-aa779aa51c04 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:43.570515 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-21bb3f76-0c6e-47cc-8bcd-aa779aa51c04 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1562 microversion: 2.1 time: 0.166484 Jun 21 16:10:43.571073 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 623/1257] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:43 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:44.354300 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-d812e110-a1cb-4a0b-b646-bf17b375cfcd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:44.354821 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d812e110-a1cb-4a0b-b646-bf17b375cfcd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:44.359661 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=33 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:44.366171 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d812e110-a1cb-4a0b-b646-bf17b375cfcd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:44.366644 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d812e110-a1cb-4a0b-b646-bf17b375cfcd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:44.367498 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d812e110-a1cb-4a0b-b646-bf17b375cfcd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:44.368002 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-d812e110-a1cb-4a0b-b646-bf17b375cfcd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:44.395101 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-d812e110-a1cb-4a0b-b646-bf17b375cfcd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:10:44.420269 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-0d6ec91d-734d-4d7e-95cf-068ebe9ded73 req-b7be1c4d-8e16-4027-9df6-3714f9a227da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a09126a-29a2-4e4f-ac02-9778a4e9ee3d", "tag": "f004a60c-9f07-4f6e-b147-72121cb96d03"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:10:44.428566 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-0d6ec91d-734d-4d7e-95cf-068ebe9ded73 req-b7be1c4d-8e16-4027-9df6-3714f9a227da service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:44.429011 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-0d6ec91d-734d-4d7e-95cf-068ebe9ded73 req-b7be1c4d-8e16-4027-9df6-3714f9a227da service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:44.442944 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-0d6ec91d-734d-4d7e-95cf-068ebe9ded73 req-b7be1c4d-8e16-4027-9df6-3714f9a227da service nova] Creating event network-changed:f004a60c-9f07-4f6e-b147-72121cb96d03 for instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d on hv-cinder-84067 Jun 21 16:10:44.448007 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-0d6ec91d-734d-4d7e-95cf-068ebe9ded73 req-b7be1c4d-8e16-4027-9df6-3714f9a227da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094887 Jun 21 16:10:44.448958 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 624/1258] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:10:44.490273 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-d812e110-a1cb-4a0b-b646-bf17b375cfcd tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 204 len: 0 microversion: 2.1 time: 0.138402 Jun 21 16:10:44.491385 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 635/1259] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:10:44 2022] DELETE /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:10:44.500208 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-07a3f967-2260-4dde-9edd-0160fa378985 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:44.500902 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-07a3f967-2260-4dde-9edd-0160fa378985 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:44.508256 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-07a3f967-2260-4dde-9edd-0160fa378985 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:44.508806 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-07a3f967-2260-4dde-9edd-0160fa378985 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:44.509802 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-07a3f967-2260-4dde-9edd-0160fa378985 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:44.510284 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-07a3f967-2260-4dde-9edd-0160fa378985 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:44.650188 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-07a3f967-2260-4dde-9edd-0160fa378985 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:44.657883 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-07a3f967-2260-4dde-9edd-0160fa378985 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1577 microversion: 2.1 time: 0.161800 Jun 21 16:10:44.658691 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 625/1260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:44 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:10:45.677499 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-dfe74eaf-7124-402e-a313-4176a30ae5d5 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:45.678232 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-dfe74eaf-7124-402e-a313-4176a30ae5d5 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:45.684985 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dfe74eaf-7124-402e-a313-4176a30ae5d5 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:45.685449 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dfe74eaf-7124-402e-a313-4176a30ae5d5 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:45.686318 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dfe74eaf-7124-402e-a313-4176a30ae5d5 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:45.686745 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-dfe74eaf-7124-402e-a313-4176a30ae5d5 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:45.854197 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-dfe74eaf-7124-402e-a313-4176a30ae5d5 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:45.862773 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-dfe74eaf-7124-402e-a313-4176a30ae5d5 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1577 microversion: 2.1 time: 0.190323 Jun 21 16:10:45.863311 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 636/1261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:45 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:46.552113 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-eaf8d1b4-5049-436d-8888-0eb23d93c6fd req-21e3914d-b936-4f7d-a8a4-e2675ff5167d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a09126a-29a2-4e4f-ac02-9778a4e9ee3d", "name": "network-vif-deleted", "tag": "f004a60c-9f07-4f6e-b147-72121cb96d03"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:10:46.560817 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-eaf8d1b4-5049-436d-8888-0eb23d93c6fd req-21e3914d-b936-4f7d-a8a4-e2675ff5167d service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:46.561321 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-eaf8d1b4-5049-436d-8888-0eb23d93c6fd req-21e3914d-b936-4f7d-a8a4-e2675ff5167d service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:46.572914 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-eaf8d1b4-5049-436d-8888-0eb23d93c6fd req-21e3914d-b936-4f7d-a8a4-e2675ff5167d service nova] Creating event network-vif-deleted:f004a60c-9f07-4f6e-b147-72121cb96d03 for instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d on hv-cinder-84067 Jun 21 16:10:46.578037 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-eaf8d1b4-5049-436d-8888-0eb23d93c6fd req-21e3914d-b936-4f7d-a8a4-e2675ff5167d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029614 Jun 21 16:10:46.578704 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 626/1262] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:10:46.881286 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:46.882068 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:46.889494 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:46.890166 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:46.890998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:46.891529 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:46.941890 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:46.942427 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:46.942943 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.objects.instance [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lazy-loading 'fault' on Instance uuid 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d {{(pid=123938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:10:46.985919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:46.994050 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-0bbde8da-5359-49fb-b882-45a44e6d3051 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 200 len: 1229 microversion: 2.1 time: 0.117270 Jun 21 16:10:46.994622 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 637/1263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:46 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 1229 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:48.012279 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:48.012959 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:48.019976 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:48.020421 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:48.021221 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:48.021650 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:48.036283 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] HTTP exception thrown: Instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d could not be found. Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Request method failure captured: Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d HTTP/1.1 Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiset4_DRo-EnBREsEgYE8p7XIxPivHtsYt6-qrNIgBQYDLa1OULRsRs-HzALAAP9S16pvmPoM1lIg8rWqv737DRUv5vW42P1cRFGcxMxBOy3fGpVOgaYezstCqwNsAvDtDGtc66s8P4zgIx7PNKqFEDI8pKN8OS5j9Q52tJrhTAWoY3U Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:10:48.038003 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/658a35680c70498db2bccc1085c22b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_658a35680c70498db2bccc1085c22b21", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 0943474b3d4d49d7973619388dab2be1 Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d could not be found. Jun 21 16:10:48.039677 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '5a09126a-29a2-4e4f-ac02-9778a4e9ee3d'} Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d could not be found. Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:10:48.040550 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d could not be found. Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d could not be found. Jun 21 16:10:48.041974 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:48.043573 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Returning 404 to user: Instance 5a09126a-29a2-4e4f-ac02-9778a4e9ee3d could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:10:48.043573 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-9b850399-17e2-4c2f-8310-e71a7589cc3c tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d" status: 404 len: 111 microversion: 2.1 time: 0.032546 Jun 21 16:10:48.043573 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 627/1264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:48 2022] GET /compute/v2.1/servers/5a09126a-29a2-4e4f-ac02-9778a4e9ee3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:10:51.453034 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-ea33b415-f60b-4922-94cf-3e1c18fe70e9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:51.453620 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ea33b415-f60b-4922-94cf-3e1c18fe70e9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:51.456289 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-e10063eb-8285-42aa-a988-405e6455f87a req-022a36a2-c80f-483f-a69b-c7b1184f4a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f8c983-c477-4e4e-9849-b32ce457ae59", "tag": "0713c871-4f3f-44fa-9891-a72dde86a445"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:10:51.461967 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea33b415-f60b-4922-94cf-3e1c18fe70e9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:51.462412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea33b415-f60b-4922-94cf-3e1c18fe70e9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:51.463173 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea33b415-f60b-4922-94cf-3e1c18fe70e9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:51.463580 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-ea33b415-f60b-4922-94cf-3e1c18fe70e9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:51.465701 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-e10063eb-8285-42aa-a988-405e6455f87a req-022a36a2-c80f-483f-a69b-c7b1184f4a1e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:51.466265 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-e10063eb-8285-42aa-a988-405e6455f87a req-022a36a2-c80f-483f-a69b-c7b1184f4a1e service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:51.480204 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-e10063eb-8285-42aa-a988-405e6455f87a req-022a36a2-c80f-483f-a69b-c7b1184f4a1e service nova] Creating event network-changed:0713c871-4f3f-44fa-9891-a72dde86a445 for instance 85f8c983-c477-4e4e-9849-b32ce457ae59 on hv-cinder-84067 Jun 21 16:10:51.486578 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-e10063eb-8285-42aa-a988-405e6455f87a req-022a36a2-c80f-483f-a69b-c7b1184f4a1e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034343 Jun 21 16:10:51.487985 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 628/1265] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:10:51.495355 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-ea33b415-f60b-4922-94cf-3e1c18fe70e9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:10:51.591000 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-ea33b415-f60b-4922-94cf-3e1c18fe70e9 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 204 len: 0 microversion: 2.1 time: 0.141665 Jun 21 16:10:51.592393 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 638/1266] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:10:51 2022] DELETE /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:10:51.601376 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-0f023e85-8df3-4444-b07e-70450f6d3b13 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:51.602351 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-0f023e85-8df3-4444-b07e-70450f6d3b13 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:51.609034 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0f023e85-8df3-4444-b07e-70450f6d3b13 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:51.609487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0f023e85-8df3-4444-b07e-70450f6d3b13 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:51.610333 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0f023e85-8df3-4444-b07e-70450f6d3b13 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:51.610748 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-0f023e85-8df3-4444-b07e-70450f6d3b13 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:51.758894 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-0f023e85-8df3-4444-b07e-70450f6d3b13 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:51.766927 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-0f023e85-8df3-4444-b07e-70450f6d3b13 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1575 microversion: 2.1 time: 0.170178 Jun 21 16:10:51.767715 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 629/1267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:51 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:52.785683 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6bc6a3a4-26b1-4c15-bb02-f19bd7199dc2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:52.786412 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6bc6a3a4-26b1-4c15-bb02-f19bd7199dc2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:52.793110 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6bc6a3a4-26b1-4c15-bb02-f19bd7199dc2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:52.793555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6bc6a3a4-26b1-4c15-bb02-f19bd7199dc2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:52.794353 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6bc6a3a4-26b1-4c15-bb02-f19bd7199dc2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:52.794793 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6bc6a3a4-26b1-4c15-bb02-f19bd7199dc2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:52.999971 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-6bc6a3a4-26b1-4c15-bb02-f19bd7199dc2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0943474b3d4d49d7973619388dab2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658a35680c70498db2bccc1085c22b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:10:53.008082 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6bc6a3a4-26b1-4c15-bb02-f19bd7199dc2 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 200 len: 1457 microversion: 2.1 time: 0.227037 Jun 21 16:10:53.008849 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 639/1268] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:52 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 1457 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:10:53.177765 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-f7c5ae16-dd16-4e7a-8c1d-c4886b6a5f43 req-08b8f1c3-4651-4118-8446-68bb4188805b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f8c983-c477-4e4e-9849-b32ce457ae59", "name": "network-vif-deleted", "tag": "0713c871-4f3f-44fa-9891-a72dde86a445"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:10:53.186688 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-f7c5ae16-dd16-4e7a-8c1d-c4886b6a5f43 req-08b8f1c3-4651-4118-8446-68bb4188805b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:53.187128 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-f7c5ae16-dd16-4e7a-8c1d-c4886b6a5f43 req-08b8f1c3-4651-4118-8446-68bb4188805b service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:53.199399 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-f7c5ae16-dd16-4e7a-8c1d-c4886b6a5f43 req-08b8f1c3-4651-4118-8446-68bb4188805b service nova] Creating event network-vif-deleted:0713c871-4f3f-44fa-9891-a72dde86a445 for instance 85f8c983-c477-4e4e-9849-b32ce457ae59 on hv-cinder-84067 Jun 21 16:10:53.204413 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-f7c5ae16-dd16-4e7a-8c1d-c4886b6a5f43 req-08b8f1c3-4651-4118-8446-68bb4188805b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030432 Jun 21 16:10:53.205075 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 630/1269] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:10:54.024471 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:54.025086 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: 85f8c983-c477-4e4e-9849-b32ce457ae59] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:54.032012 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:54.032459 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:54.033218 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:54.033653 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:54.047586 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] HTTP exception thrown: Instance 85f8c983-c477-4e4e-9849-b32ce457ae59 could not be found. Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Request method failure captured: Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 HTTP/1.1 Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABiset4_DRo-EnBREsEgYE8p7XIxPivHtsYt6-qrNIgBQYDLa1OULRsRs-HzALAAP9S16pvmPoM1lIg8rWqv737DRUv5vW42P1cRFGcxMxBOy3fGpVOgaYezstCqwNsAvDtDGtc66s8P4zgIx7PNKqFEDI8pKN8OS5j9Q52tJrhTAWoY3U Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:10:54.049212 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/658a35680c70498db2bccc1085c22b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_658a35680c70498db2bccc1085c22b21", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 0943474b3d4d49d7973619388dab2be1 Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance 85f8c983-c477-4e4e-9849-b32ce457ae59 could not be found. Jun 21 16:10:54.051409 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': '85f8c983-c477-4e4e-9849-b32ce457ae59'} Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f8c983-c477-4e4e-9849-b32ce457ae59 could not be found. Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:10:54.052411 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f8c983-c477-4e4e-9849-b32ce457ae59 could not be found. Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f8c983-c477-4e4e-9849-b32ce457ae59 could not be found. Jun 21 16:10:54.054124 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.055712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Returning 404 to user: Instance 85f8c983-c477-4e4e-9849-b32ce457ae59 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:10:54.055712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-8a9b7424-fe5f-4f3a-83f4-1938431d85ad tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59" status: 404 len: 111 microversion: 2.1 time: 0.030280 Jun 21 16:10:54.055712 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 640/1270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:54 2022] GET /compute/v2.1/servers/85f8c983-c477-4e4e-9849-b32ce457ae59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:10:54.522588 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:54.523156 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:54.529577 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:54.530061 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:54.530820 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:54.531257 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:54.544970 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] HTTP exception thrown: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Request method failure captured: Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: DELETE /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 HTTP/1.1 Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiset4_DRo-EnBREsEgYE8p7XIxPivHtsYt6-qrNIgBQYDLa1OULRsRs-HzALAAP9S16pvmPoM1lIg8rWqv737DRUv5vW42P1cRFGcxMxBOy3fGpVOgaYezstCqwNsAvDtDGtc66s8P4zgIx7PNKqFEDI8pKN8OS5j9Q52tJrhTAWoY3U Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:10:54.546667 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/658a35680c70498db2bccc1085c22b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_658a35680c70498db2bccc1085c22b21", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 0943474b3d4d49d7973619388dab2be1 Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.548526 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': 'bdb343e0-4cd2-4d5e-96e7-3118e40b27d9'} Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:10:54.549930 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.551487 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.553193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Returning 404 to user: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:10:54.553193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-8308c855-67dd-4260-8e95-1dd395fdbd6d tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 404 len: 111 microversion: 2.1 time: 0.030581 Jun 21 16:10:54.553193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 631/1271] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:10:54 2022] DELETE /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:10:54.557088 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:54.557690 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] [instance: bdb343e0-4cd2-4d5e-96e7-3118e40b27d9] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:10:54.564055 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:54.564499 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:54.565283 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:10:54.565800 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:10:54.579247 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.wsgi [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] HTTP exception thrown: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Request method failure captured: Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: request: GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 HTTP/1.1 Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept: application/json Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Accept-Encoding: identity Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Connection: close Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Length: 0 Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Content-Type: application/json Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Host: 10.222.0.52 Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Openstack-System-Scope: None Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: User-Agent: python-urllib3/1.26.9 Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Auth-Token: gAAAAABiset4_DRo-EnBREsEgYE8p7XIxPivHtsYt6-qrNIgBQYDLa1OULRsRs-HzALAAP9S16pvmPoM1lIg8rWqv737DRUv5vW42P1cRFGcxMxBOy3fGpVOgaYezstCqwNsAvDtDGtc66s8P4zgIx7PNKqFEDI8pKN8OS5j9Q52tJrhTAWoY3U Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Id: None Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Domain-Name: None Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Identity-Status: Confirmed Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Is-Admin-Project: True Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Id: default Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Domain-Name: Default Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Project-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Role: reader,member Jun 21 16:10:54.580864 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Roles: reader,member Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/658a35680c70498db2bccc1085c22b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/658a35680c70498db2bccc1085c22b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_658a35680c70498db2bccc1085c22b21", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Id: 658a35680c70498db2bccc1085c22b21 Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-Tenant-Name: tempest-TestVolumeBootPattern-263623053 Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Id: default Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Domain-Name: Default Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Id: 0943474b3d4d49d7973619388dab2be1 Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: X-User-Name: tempest-TestVolumeBootPattern-263623053-project Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: method: > Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: exception: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.583424 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: action_args: {'id': 'bdb343e0-4cd2-4d5e-96e7-3118e40b27d9'} Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:10:54.584555 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. Jun 21 16:10:54.586158 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: ERROR nova.api.openstack.wsgi Jun 21 16:10:54.587783 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Returning 404 to user: Instance bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 could not be found. {{(pid=123938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:10:54.587783 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-e6df37ae-751a-4561-b246-0c816424f1b7 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9" status: 404 len: 111 microversion: 2.1 time: 0.029354 Jun 21 16:10:54.587783 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 641/1272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:10:54 2022] GET /compute/v2.1/servers/bdb343e0-4cd2-4d5e-96e7-3118e40b27d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 16:10:55.895422 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-51eec9ad-d8f9-4297-a9cd-245d057cd317 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] Calling method '.version_select at 0x7f73b5f789d0>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:10:55.920457 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-51eec9ad-d8f9-4297-a9cd-245d057cd317 tempest-TestVolumeBootPattern-263623053 tempest-TestVolumeBootPattern-263623053-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-877953109" status: 202 len: 0 microversion: 2.1 time: 0.029696 Jun 21 16:10:55.921536 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 632/1273] 10.222.0.52 () {58 vars in 1259 bytes} [Tue Jun 21 16:10:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-877953109 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:12:13.361677 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:12:13.363470 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG dbcounter [-] [123938] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:12:13.364169 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_cell1:SELECT=29 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:12:13.364945 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG dbcounter [-] [123939] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=123939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:12:13.368522 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-6d5ae474-6483-40b6-a8f5-5636918e4f5b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:12:13.368934 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6d5ae474-6483-40b6-a8f5-5636918e4f5b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:12:13.369095 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-667539f0-88e3-45ee-be19-b397996641a4 req-684044ab-c15b-4460-b486-30d4b1286580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475bce88-8d72-4c08-b431-f5987c6b95a0", "tag": "b9276118-8bc8-43ec-a759-26c8224ec857"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:12:13.377394 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d5ae474-6483-40b6-a8f5-5636918e4f5b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:13.378095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d5ae474-6483-40b6-a8f5-5636918e4f5b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:13.379564 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d5ae474-6483-40b6-a8f5-5636918e4f5b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:13.379714 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-667539f0-88e3-45ee-be19-b397996641a4 req-684044ab-c15b-4460-b486-30d4b1286580 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:13.379972 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-6d5ae474-6483-40b6-a8f5-5636918e4f5b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:13.380097 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-667539f0-88e3-45ee-be19-b397996641a4 req-684044ab-c15b-4460-b486-30d4b1286580 service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:13.392916 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-667539f0-88e3-45ee-be19-b397996641a4 req-684044ab-c15b-4460-b486-30d4b1286580 service nova] Creating event network-changed:b9276118-8bc8-43ec-a759-26c8224ec857 for instance 475bce88-8d72-4c08-b431-f5987c6b95a0 on hv-cinder-84067 Jun 21 16:12:13.398644 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-667539f0-88e3-45ee-be19-b397996641a4 req-684044ab-c15b-4460-b486-30d4b1286580 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036711 Jun 21 16:12:13.399226 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 633/1274] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:12:13.407884 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-6d5ae474-6483-40b6-a8f5-5636918e4f5b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Going to try to terminate instance {{(pid=123938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:12:13.512780 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-6d5ae474-6483-40b6-a8f5-5636918e4f5b tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "DELETE /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 204 len: 0 microversion: 2.1 time: 0.152848 Jun 21 16:12:13.513858 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 642/1275] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jun 21 16:12:13 2022] DELETE /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:12:13.523826 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-c6d3f202-bfa0-4068-9cb5-3e1e50184015 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:12:13.524807 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-c6d3f202-bfa0-4068-9cb5-3e1e50184015 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:12:13.531992 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6d3f202-bfa0-4068-9cb5-3e1e50184015 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:13.532696 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6d3f202-bfa0-4068-9cb5-3e1e50184015 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:13.533541 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6d3f202-bfa0-4068-9cb5-3e1e50184015 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:13.534135 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-c6d3f202-bfa0-4068-9cb5-3e1e50184015 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:13.693202 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.policy [None req-c6d3f202-bfa0-4068-9cb5-3e1e50184015 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123939) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:12:13.701121 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-c6d3f202-bfa0-4068-9cb5-3e1e50184015 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.181545 Jun 21 16:12:13.701666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 634/1276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:12:13 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:12:14.718879 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-fb17aabb-8aca-48c6-8b00-711f9895fe4e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:12:14.719610 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-fb17aabb-8aca-48c6-8b00-711f9895fe4e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:12:14.727909 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fb17aabb-8aca-48c6-8b00-711f9895fe4e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:14.728329 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fb17aabb-8aca-48c6-8b00-711f9895fe4e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:14.729095 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fb17aabb-8aca-48c6-8b00-711f9895fe4e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:14.730161 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-fb17aabb-8aca-48c6-8b00-711f9895fe4e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:14.881425 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-fb17aabb-8aca-48c6-8b00-711f9895fe4e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:12:14.889721 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-fb17aabb-8aca-48c6-8b00-711f9895fe4e tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1568 microversion: 2.1 time: 0.175116 Jun 21 16:12:14.890340 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 643/1277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:12:14 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:12:15.606296 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [req-4fb596a4-e49b-4fd4-9e3b-8bdd62f990ba req-136beefb-d59e-4744-913e-c16b8688f9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475bce88-8d72-4c08-b431-f5987c6b95a0", "name": "network-vif-deleted", "tag": "b9276118-8bc8-43ec-a759-26c8224ec857"}]} {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:12:15.615747 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-4fb596a4-e49b-4fd4-9e3b-8bdd62f990ba req-136beefb-d59e-4744-913e-c16b8688f9dc service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:15.616193 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [req-4fb596a4-e49b-4fd4-9e3b-8bdd62f990ba req-136beefb-d59e-4744-913e-c16b8688f9dc service nova] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:15.628218 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.compute.server_external_events [req-4fb596a4-e49b-4fd4-9e3b-8bdd62f990ba req-136beefb-d59e-4744-913e-c16b8688f9dc service nova] Creating event network-vif-deleted:b9276118-8bc8-43ec-a759-26c8224ec857 for instance 475bce88-8d72-4c08-b431-f5987c6b95a0 on hv-cinder-84067 Jun 21 16:12:15.633666 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [req-4fb596a4-e49b-4fd4-9e3b-8bdd62f990ba req-136beefb-d59e-4744-913e-c16b8688f9dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Jun 21 16:12:15.634312 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 635/1278] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jun 21 16:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:12:15.907278 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-9fd6f09b-3a3a-4abd-90a3-303e0bfcc6f1 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:12:15.908139 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.compute.api [None req-9fd6f09b-3a3a-4abd-90a3-303e0bfcc6f1 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123938) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:12:15.915387 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9fd6f09b-3a3a-4abd-90a3-303e0bfcc6f1 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:15.915821 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9fd6f09b-3a3a-4abd-90a3-303e0bfcc6f1 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:15.916578 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9fd6f09b-3a3a-4abd-90a3-303e0bfcc6f1 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:15.917001 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG oslo_concurrency.lockutils [None req-9fd6f09b-3a3a-4abd-90a3-303e0bfcc6f1 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:15.989754 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.policy [None req-9fd6f09b-3a3a-4abd-90a3-303e0bfcc6f1 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8617fdc3e63446c89fcd22bd5756109d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4016a8a7626d4aa5a28d248a5a799e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123938) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:12:15.998155 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-9fd6f09b-3a3a-4abd-90a3-303e0bfcc6f1 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 200 len: 1219 microversion: 2.1 time: 0.095279 Jun 21 16:12:15.998820 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 644/1279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:12:15 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:12:17.017761 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '>' {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:12:17.018506 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.compute.api [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] [instance: 475bce88-8d72-4c08-b431-f5987c6b95a0] Fetching instance by UUID {{(pid=123939) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:12:17.025450 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:17.025926 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:17.026697 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:12:17.027124 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG oslo_concurrency.lockutils [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Lock "ecb9b484-66dd-44e4-a1fd-b11b99b80367" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:12:17.042885 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.wsgi [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] HTTP exception thrown: Instance 475bce88-8d72-4c08-b431-f5987c6b95a0 could not be found. Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Request method failure captured: Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: request: GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 HTTP/1.1 Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept: application/json Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Accept-Encoding: identity Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Connection: close Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Length: 0 Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Content-Type: application/json Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Host: 10.222.0.52 Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Openstack-System-Scope: None Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: User-Agent: python-urllib3/1.26.9 Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Auth-Token: gAAAAABiseyj8P0ssgy1XnKD3CQ9tW99kDwoyNBwfJ1MCBK7M5FFpBR10V364bieDp--SJFAhXWeTlS-lVCMQCHon76Z0u2Ez_l6qFtseurHGjcGaE3SvtlP6c7uR-t-vhhzlbo4O84VwK6md_s4hE82Mn2JIWQeNRKINZPJSrEG1HxTZ53xU08 Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Id: None Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Domain-Name: None Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Identity-Status: Confirmed Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Is-Admin-Project: True Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Id: default Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Domain-Name: Default Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Id: 4016a8a7626d4aa5a28d248a5a799e8e Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Project-Name: tempest-TestShelveInstance-1215926872 Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Role: reader,member Jun 21 16:12:17.044549 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Roles: reader,member Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4016a8a7626d4aa5a28d248a5a799e8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4016a8a7626d4aa5a28d248a5a799e8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4016a8a7626d4aa5a28d248a5a799e8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4016a8a7626d4aa5a28d248a5a799e8e", "adminURL": "http://10.222.0.52:8080"}]}] Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant: tempest-TestShelveInstance-1215926872 Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Id: 4016a8a7626d4aa5a28d248a5a799e8e Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-Tenant-Name: tempest-TestShelveInstance-1215926872 Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User: tempest-TestShelveInstance-1215926872-project Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Id: default Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Domain-Name: Default Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Id: 8617fdc3e63446c89fcd22bd5756109d Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: X-User-Name: tempest-TestShelveInstance-1215926872-project Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: method: > Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: exception: Instance 475bce88-8d72-4c08-b431-f5987c6b95a0 could not be found. Jun 21 16:12:17.046458 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: action_args: {'id': '475bce88-8d72-4c08-b431-f5987c6b95a0'} Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: {{(pid=123939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475bce88-8d72-4c08-b431-f5987c6b95a0 could not be found. Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:12:17.047513 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475bce88-8d72-4c08-b431-f5987c6b95a0 could not be found. Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475bce88-8d72-4c08-b431-f5987c6b95a0 could not be found. Jun 21 16:12:17.049175 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: ERROR nova.api.openstack.wsgi Jun 21 16:12:17.051297 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: DEBUG nova.api.openstack.wsgi [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Returning 404 to user: Instance 475bce88-8d72-4c08-b431-f5987c6b95a0 could not be found. {{(pid=123939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:12:17.051297 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO nova.api.openstack.requestlog [None req-76f08964-b56e-4fb2-97f4-c3f8c6373a01 tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0" status: 404 len: 111 microversion: 2.1 time: 0.032948 Jun 21 16:12:17.051297 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: [pid: 123939|app: 0|req: 636/1280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jun 21 16:12:17 2022] GET /compute/v2.1/servers/475bce88-8d72-4c08-b431-f5987c6b95a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:12:17.213579 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: DEBUG nova.api.openstack.wsgi [None req-67f8d1bb-aa48-45a0-aa04-ca33a0ca4f7a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] Calling method '.version_select at 0x7f73b5b97550>' {{(pid=123938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:12:17.236959 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO nova.api.openstack.requestlog [None req-67f8d1bb-aa48-45a0-aa04-ca33a0ca4f7a tempest-TestShelveInstance-1215926872 tempest-TestShelveInstance-1215926872-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1305804171" status: 202 len: 0 microversion: 2.1 time: 0.027207 Jun 21 16:12:17.239892 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: [pid: 123938|app: 0|req: 645/1281] 10.222.0.52 () {58 vars in 1253 bytes} [Tue Jun 21 16:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1305804171 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:13:51.301768 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:13:51.302423 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Tue Jun 21 16:13:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:13:53.461383 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:13:53.462042 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Tue Jun 21 16:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:15:20.730444 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:15:20.731166 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Tue Jun 21 16:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:15:34.511306 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:15:34.511943 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Tue Jun 21 16:15:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:17:11.311142 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:17:11.312307 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Tue Jun 21 16:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:17:13.470919 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:17:13.471552 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Tue Jun 21 16:17:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:17:31.994751 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:17:31.995998 dv-cinder-840678-13-iscsi devstack@n-api.service[123938]: Tue Jun 21 16:17:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 16:17:32.740345 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 16:17:32.741263 dv-cinder-840678-13-iscsi devstack@n-api.service[123939]: Tue Jun 21 16:17:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!